Local Government New Zealand has long been calling for a drinking water regulator and says oversight has been neglected.
"The system as it stands is not fit for purpose," LGNZ president Dave Cull says.
"Because it doesn't set a robust standard, councils can actually get out of it, and because the Ministry of Health isn't enforcing it anyway,"
But he says councils over the next decade are also facing a "tsunami" of other programmes, including the Zero Carbon Bill and Three Waters Reform and serious conversation will need to be had about how to pay for it all.
"It's got to be spread, it's got to be managed,so that it's affordable for ratepayers, because in the end it's ratepayers that are paying," he said.
"There will small councils for who there is no way ... There will need to be negotiations about assistance for them."
The Government says it recognises the cost of upgrades to smaller communities, towns, marae and provincial areas could be too much.
It hopes to have a plan for how to manage this later this year.
Some larger councils could face trouble too, Cull said.
"Some of the big councils already reaching their debt ceilings are going to face some challenges. It's not just equity, it's affordability," he said.
But there was overwhelming demand in communities for clean rivers and water and councils were committed to change, he said.
"The next big thing is getting the regulator in place and getting the regulatory standard set. And then we'll be able to ascertain what it's going to cost," he said.
"But there's no point in throwing up our hands up and saying: 'The sky is falling in. Because we can't afford this we shouldn't'. We all know there needs to be a better standard."
The Government's drinking water standards will apply to all but those supplying their own water.
About 3.6 million people in New Zealand are estimated to get their water from 1800 larger "networked" suppliers. There's an estimate 336,000 people who self-supply.
The National Party said it supported a water regulator, but had concerns about the burden on councils.
"How much will it cost rural marae and papakāinga, or other small self-suppliers like rugby clubrooms and community halls, to fall in line with the new regulations?," National Local Government spokeswoman Jacqui Dean said.