Mr Stevens, spokesman for the Martinborough Community Centre Steering Group, said it was a project adding 80 years of life to a building "which would have benefited the whole community and the district".
He said he did not believe the rate was a huge cost for the community.
Between $50 to $75 would be added to residents' rates bill each year for 20 years.
"It's not a huge burden on the average rate payer and they get a lot of bang for their buck."
Mr Stevens said the steering group had worked "extremely hard" over the past four years gathering support for the project.
"The people who have been putting in all the work to date I can't see them going and putting in another four years into the project, it's time consuming to raise the funds."
More than $2.2 million for the project had been raised through bequests, donations and external grants. Mr Stevens said the whole process had been democratic and many people saw the concept as something that would assist the community.
"We have a lot of visitors and having a new complex that we can be proud of would have attracted more people."
If the outcome to the construct the Waihinga Centre was unfavourable it would be "back to square one", Mr Stevens said.
Martinborough Ratepayers Action Group chairperson Graham Higginson said the group were "very pleased" with the poll result.
"The number of submissions received by council show how committed the Martinborough community are to the future wellbeing of the town and to fiscal common sense."
He said the proposed targeted rate could "burden the ratepayers for many years to come" paying for the "costly" facility.
"We believe the current project does not have the mandate of the majority of the community and the voting outcome verifies this."
Mr Higginson said SWDC should "return to the planning phase and this time ensure full consultation and community engagement throughout the process".
The process continues with 34 submissions presented to a council hearings panel, which will be independently chaired by former Kapiti District mayor Jenny Rowan, on Wednesday from 9.30am.
Members of the public are welcome to attend the hearings at the council, but will be excluded from the panel deliberations which will follow.
The council will make a decision on the proposal immediately afterwards at a special public meeting starting at 2pm.
South Wairarapa mayor Adrienne Staples said at an information evening a few weeks ago she thought councillors would need a clear mandate for the project to get the green light.