The government had previously put debt limits on council but they were repealed two decades ago.
"This may need to be reconsidered," Mr Smith said.
Council amalgamation could be one way to achieve an efficient local government organisation, looking at the Auckland council model as an example.
Mr Smith is also the MP for Nelson where the Local Government Commission is considering a plan to merge Nelson and Tasman councils.
"We want to facilitate a sensible dialogue on reform," he said.
Hastings Mayor Lawrence Yule, who is also the president of Local Government New Zealand, said he had spoken to Mr Smith earlier this year on what the new minister's goals would be for the new term.
"The government has signalled it's not going to force council reform but now communities and regions are being asked to find better ways to operate," he said.
"I think it's probably going to look at efficiencies in delivering services such as building, compliance type services, maintenance of roads, better alignment between central and council."
Hawke's Bay Regional Council chairman Fenton Wilson said he had no formal approach from Mr Smith regarding suggestions that reorganisation would include abolishing regional councils.
"It's early days yet," Mr Wilson said. "Mr Smith is fairly new in his role as local government minister and hasn't had enough time to see for himself how we operate.
"I don't think regional councils are an extra layer over the district and city councils. Regional councils actually hold a lot of information, data and wealth of knowledge of water and land issues and I can't see how you could lump that into one council."