The greenback gained in Asia after Powell told the Senate Banking Committee "the case for raising interest rates at our next meeting is coming together."
Investors were also cheered by signs of progress on US tax cuts. According to Reuters, Senate Republicans "rammed forward" their bill in a partisan committee vote that set up a full vote by the Senate as soon as Thursday, although details of the measure remained unsettled.
"There's been slippage (in the kiwi) as the US dollar has ground up on the day," said Westpac Banking Corp senior strategist Imre Speizer.
The greenback was also helped when equities - particularly banking stocks- pushed higher after Powell said the Fed will be reviewing how it regulates banks, with an eye to a less onerous process.
Speizer said domestically the central bank's move to ease loan-to-value restrictions from January as housing market pressures abate was a big surprise and a "bold move."
From January 1, up to 15 per cent of a bank's new lending can go to owner-occupiers borrowers putting down less than a fifth of the price for a deposit, up from the original 10 per cent.
Property investors will also get a break, with 5 per cent of new mortgage lending allowed at a 65 per cent LVR, up from a 60 per cent.
However, while it should have pushed the kiwi higher "the big US dollar movement has dominated and put the LVR news on the sideline," said Speizer.
The kiwi dollar fell to 90.80 Australian cents from 91.08 cents yesterday and traded at 58.12 euro cents from 58.18 cents and 51.55 British pence from 51.97 pence. It fell to 4.5455 yuan from 4.5743 yuan and slipped to 76.78 yen from 77.02 yen.
New Zealand's two-year swap rate fell 1 basis point to 2.14 while the 10-year swap rate fell 3 basis point to 3.08 per cent.