"This looks like protest to me and it's quite a legitimate form of expression, but there's a lot of other people out there who will commit cyber crime if you let them and that's why we need a strong legislative structure to enable the New Zealand Government to play its role in protecting what's now becoming vital infrastructure,'' Mr English said.
He said the Government had not taken any further measures to protect other core infrastructure from cybercrime - other than existing protections.
Justice Minister Judith Collins said her site was back up, but when APNZ checked her site was still out of order.
She said that Anonymous had "tremendous powers'' and it wasn't a valid form of protest.
She believed it could be a form of cyber crime, but her main concern was around online child sex abuse and didn't believe they should be charged for hacking ministerial websites.
"They wreak havoc, not only in Government but could also do it in people's private websites and bank accounts.
"This is a good reason to show there are cyber criminals out there,'' said Ms Collins.
Labour Minister Simon Bridges shrugged off the attack on his own site.
"I am very concerned about the hundreds of thousands of people who will have been looking at it daily now don't know what to do.''
"The technical advice I've had is it could take some time to back up, as it does have a lot of photos of me on it - I'm thinking over a period of days we'll have it up and running,'' he said sarcastically.
The hacking group Anonymous sent a message via Youtube saying they had taken over 14 websites linked to the National Party as a protest against the GCSB Bill.
The hackers had no thanks from internet mogul Kim Dotcom.
In a tweet this morning to the group he told them hacking National Party websites was just giving John Key a new excuse to pass the bill, and asked them to stop it.
Dear Anonymous NZ, hacking National Party websites is just giving John Key a new excuse to pass the #GCSB bill (cybercrime). Please stop it.