Board deputy chairwoman Anna Wilson said the board was disappointed by Williams’ comments.
About 30 members of the public have turned out for the meeting in the Hyde Community Hall.
Board council representative Bill Acklin is acting as chair for the meeting in place of Williams.
Council chief executive Sandy Graham is also present.
Shane Loader, presenting in the public forum, said the area had become a symbol of the racist underbelly of New Zealand.
“It’s going to be hard to shake off that reputation.”
The board was now a lame duck incapable of representing the community.
“Some on the board believe Barry should continue as chairman because he got the most votes,” Loader said.
He rejected that outlook and said Williams was not a team player.
He had started his presentation talking about tourism and Cr Bill Acklin asked him to stay on topic.
Loader said the area should be one people would want to visit.
Andrea Bosshard decried bullying, racism and misogyny and said people in the community were fearful of speaking out.
Some people had a misplaced conception Williams was a victim.
“The victim is the woman who has left in town,” Ms Bosshard said.
“In order to bridge political divides, leadership is crucial. If he is a courageous man, he will step down with grace.”
The council had called on Williams to resign and in a letter penned by Dunedin Mayor Jules Radich said: “Council is appalled by your behaviour, which is a clear breach of the code of conduct and a serious failure to uphold the standard of behaviour expected of an elected community representative.”
The fallout from the complaint has spread to Radich, who faces censure for minimising the racial slur in a radio interview.
Following the RNZ interview, Deputy Mayor Sophie Barker and Cr Jim O’Malley laid a code of conduct complaint about Radich to the Dunedin City Council last Friday.
Cr Barker has since resigned as deputy mayor and filed a code of conduct complaint against Cr Carmen Houlahan.
Before she stepped down as deputy mayor she disclosed she had received “17 awful texts” and eight unanswered phone calls from Cr Houlahan.
Cr Houlahan said she was shocked by Cr Barker and Cr O’Malley making the complaint about the mayor and had not realised she had sent so many text messages.
Cr Barker was furious on Monday when Cr Houlahan accused her of having a political agenda and starting campaigning for the mayoralty two years out from the election.
