The 56-year-old said roads still needed to be maintained and new infrastructure created, but things could be built "responsibly not crazily".
"It's not that these things aren't needed, it's just that they need to spread them out.
"We need to just be much more mindful that we are spending people's money."
New Zealand-born Joyce has not been a councillor before but was a financial journalist and editor overseas before moving to Katikati six years ago.
Local Democracy Reporting asked Joyce his thoughts on the Three Waters reforms that would see drinking, waste and stormwater managed by four publicly owned entities rather than councils.
He said the reforms had a "huge democratic deficit" and the council would lose its water services assets and income.
"I'm a believer in localism, decisions should be made at the most local level that's appropriate."
Local Democracy Reporting has also asked mayoral candidates their thoughts on the district council amalgamating with Tauranga City Council.
Joyce said: "Tauranga City has major problems when they haven't even got democratically-elected council."
The city council currently has four government appointed commissioners in place because of "significant governance issues" with the elected members of the previous council.
"My main attitude at the moment is why would we want to go near that?," he said. "In theory, it makes sense in practice there are a lot of fish hooks, particularly from that Tauranga side."
Roading infrastructure for the district was also important to support the Port of Tauranga, said Joyce.
"That is our most important port in New Zealand for getting exports out and getting imports in.
"We need to build in a way that meets its needs so that we can meet the economic growth and employment needs of our region."
He said the "real answer" to the transport issues was a tunnel under the Kaimai Ranges near Thompsons Track in Aongatete.
The father-of-three's plan, if he were to be elected, was to "wind back spending plans and make them more reasonable" and keep the rates low.
Public Interest Journalism funded through NZ On Air.