Greytown resident Rachel Thompson was disappointed to see it go.
"It's not just any old building.
"A lot of money was spent by the WDFU, they put up a huge amount of money for it and now it's just suddenly disappeared, it deserves a bit more recognition.
"It was built for a purpose and given to Greytown by a group of hardworking women."
She said when farmers' wives would come into town, they would take a break at the site and feed their children there.
"It was quite a special little building and it's just gone."
It was also a hardy building, surviving the 1942 earthquake, said Mrs Thompson.
The plans for the new toilets were first discussed in 2011 and budgeted for in the South Wairarapa District Council's Long Term Plan.
The cost has not yet been finalised but is expected to be under budget.
In the council plan, the toilet block was described as "outdated and requiring replacement".
Refurbishing the original building was considered but replacing it with a whole new building was considered the most cost effective option.
"It would cost more money to bring it up to a modern standard than replacing them completely," said Helen McNaught, council amenities manager.
She said the original plaque would be put back up on the new building to remember the site's history.
The new toilet block is on the original site between the Greytown Butchery and St John's.