He pointed out that central government and the city council were two of the city's biggest landowners and the biggest land-bankers.
"It's not just dirty developers who are doing that".
The potential for Auckland house prices continuing to rise above the norm and then having a sharp correction was also a risk to the government given it has $18.7 billion worth of houses on its books and 7 per cent of Auckland's housing, English said.
The Government is narrowing its focus on housing this term, having already signalled an overhaul of social housing, as it seeks to mitigate some of the financial stability risks posed by artificially high house prices, and the inequity that follows.
The Government will confirm details in the new few weeks about further decisions on the Tamaki Redevelopment Co, a joint venture between central government and Auckland Council in 2012 to rejuvenate the suburb.
The entity is expected to build about 7500 new houses over the next decade.
Once old properties have been removed or demolished, that will increase the area's housing stock by 5000, of which 2800 will be Housing New Zealand-owned.
"We want to accelerate this type of activity, so small and large redevelopments of Housing New Zealand land and properties are completed with more urgency," English said.
In terms of whether foreign buyers were responsible for the rapid growth in house prices, English also said although Australia was going down the track of a register on foreign buyers, it was difficult to prove just who was a foreigner in New Zealand.
"As we found with the Dotcom case, you can be a New Zealander under one case and not in another.
"It [a register] is a swamp that you have to know exactly how you're going to get through before you go into it."
The minister said the Government had learnt a lot over Auckland's housing issues and that should lead to a more constructive process than previously about the region's infrastructure needs, including a second harbour crossing.
"We could do with a common understanding of the strategy.
"To government, it has looked like a series of projects arriving for political reasons as well as economic ones and we have to have that common view."
He also said Auckland's congestion problems were a problem " we'd love to have in Invercargill".