The Reserve Bank is expected to hike the official cash rate (OCR) by another 50 points, from 3 per cent to 3.5 per cent, when it next reviews monetary policy on October 5.
At its last review in August, the RBNZ forecast the OCR peaking at 4 per cent next year, and remaining at that level until 2024.
Annual consumer price inflation is still way out of the Reserve Bank's 1 to 3 per cent target range, at 7.3 per cent in the June quarter.
However, the delay between the Reserve Bank changing the OCR and this feeding through into the economy, as people come to refix their debt for example, takes time.
Some economists, including those at ANZ and ASB, recently revised their OCR outlooks up following data releases both here and abroad showing inflation being more stubborn than expected, and the US Federal Reserve chair Jerome Powell talking tough on doing what it takes to kill inflation.
Other economists believe the economy won't be able to handle interest rate hikes that are much more aggressive than that projected by the RBNZ.
Most see risks to the upside – inflation being more persistent – rather than inflation being less persistent.
Orr said the Reserve Bank was "well on course" to lowering inflation.
Tighter monetary policy is expected to slow economic demand to better match supply. However, he said building supply capacity in the economy would take the strain off monetary policy.
Orr also discussed the weak New Zealand dollar, which was trading at 56.4 US cents on Tuesday morning.
He noted the US's Federal Reserve is continuing to tighten monetary conditions at pace.
"What does that mean?" Orr questioned.
"It means US interest rates are up… that makes a capital drain from the rest of the world back to the US, as money flows to where the highest yield is.
"It also creates broader economic uncertainty; it generates volatility and concern that again reinforces the desire for people to have their capital back in the US – a perceived safe place as opposed to, effectively, the rest of the world…
"Almost every currency in the world is declining against the US dollar as they look to dis-inflate along with the rest of us."