The Civic Trust said it would like to have confidence in Mr Brown, but also said the mayor had to bring about a culture change in the planning department to value heritage.
Most of the seven respondents did not have confidence in council staff to protect the city's heritage buildings.
But their view is not shared by city chief executive Doug McKay, who says he respects and commends their tough calls on sensitive issues.
Save Our St Heliers said the current regime in the planning department had been presiding over the destruction of Auckland's heritage for the past 20 years.
The Paget St case - in which a planning officer who opposed demolition was replaced by a consultant planner who supported it - demonstrated the "anti-heritage culture".
All seven respondents believed Paget St had raised public awareness about heritage issues.
On new houses in character suburbs, the overwhelming view was that council planners were not getting it right and the rules needed tightening.
"There needs to be more sensitivity in approving new buildings in character/heritage areas," said the Civic Trust, adding that there were good examples which respected their local heritage.
Asked what changes they would like to see the council make, the respondents singled out stronger leadership, a culture change in the planning department and greater community input.
Mr Brown yesterday defended his record, saying he had tried to address the short, medium and long-term needs of heritage.
The council had established a built heritage fund with $10 million to buy and upgrade historic buildings, a heritage advisory panel and a heritage forum of councillors, he said.
He acknowledged the planning culture was primarily focused on the development market, which needed to be balanced against preserving heritage.
It would take patience to get the right culture and a new planning process in place, he said. Until a new unitary plan was in place, likely to take several years, the council would take a more formidable line on heritage, Mr Brown said.
"It's not a perfect formula yet, but we are trying to balance a city that is respectful and wants to protect significant parts of its built heritage but working to meet the needs of the future community that are coming here."
HERITAGE SURVEY FINDINGS
On Paget St
* "The machinations inside council have been exposed as never before."
- Western Bays Community Group
* "The removal of the planner who was opposed to the application smacks of cronyism."
- Devonport Heritage
On council planners
* "The current regime is presiding over the destruction of Auckland's heritage and has done for the past 20 years."
- Save Our St Heliers
On new buildings
* "Too many new builds are completely out of character."
- Western Bays Community Group
On Len Brown
* "Mouths platitudes about heritage and makes empty promises."
- Devonport Heritage
See the full results of the heritage survey here.
