Rabbitts said one person getting sick from drinking water was unacceptable and that someone may have died was appalling.
"I am so angry about this," said Rabbitts.
"We knew an incident was coming; it was just a matter of when."
Most shocking, he said, was the outbreak was preventable with relatively simple treatment.
"Whether the bacteria in question are E.coli or campylobacter doesn't really matter. What matters is that the water supply got contaminated by bacteria which could have been treated by chlorine. This is a simple, effective and common treatment for the removal of bacteria and viruses."
He said the chlorine stayed in the water along the pipes and in the reservoirs giving protection against downstream contamination.
Rabbitts said the Ministry of Health must also take some responsibility.
"They wrote the Drinking Water Standards for New Zealand and they wrote the Health (Drinking Water) Amendment Act 2007. They've allowed councillors to make uninformed decisions swayed by public opinion on the risks to a water supply. And they've allowed compliance with the Drinking Water Standards to be achieved by doing nothing."
Rabbitts said Havelock North - and several other areas - relied on the "do nothing" approach so problems were only discovered after contamination occurred and people started for get sick.
Rabbitts called for an "absolute minimum" of chlorine disinfection in all water supplies to prevent it happening again elsewhere in New Zealand.
"The Ministry of Health needs to lead the effort. They need to set deadlines and provide funding to enable the chlorination of all water supplies."
He said money being spent on hospital care for those who became violently ill would have been better spent on chlorinating the water.
He warned unless changes were made it was only a matter of time before contaminated water caused widespread sickness and hospitalisation in New Zealand.
