Investment intentions across small firms fell 2 per cent, with medium-sized firms showing the biggest decline in investment enthusiasm.
Only one per cent of small firms expected to hire this year, the survey found.
The activity outlook in retail was the lowest among all sectors, while the highest was in construction.
Regulation remained the biggest concern for small business owners, followed by finding skilled workers - particularly in construction, manufacturing and retail sectors.
The ANZ composite growth measure for small firms – a key proxy for growth based on firms' own activity outlook, hiring, investment and profit expectations – fell to +10, from +20, but remained in growth territory.
Webster said indicators showed a tie-in with GDP growth.
"While sentiment may well have soured, small firms are still intending to roll up their sleeves and get on with it," he said.
Xero country manager Craig Hudson said the drop in business confidence among small businesses was inline with other survey findings.
"One reason confidence is waning could be that the election hangover is continuing and with this comes ongoing uncertainty for small businesses as to what the impact will be for them," Hudson said.
Low business confidence showed that the Government needed to be more focused on providing solutions to make business easier for small firms, he said.
"These signals from small business also present an opportunity for the Government to implement small-business policy and give small firms the focus they deserve - for example, reduced compliance costs and making it easier to do business."
I'm hoping people will see change as an opportunity - it doesn't stop your business, you still need to plan ahead and continue to look at growth.
Business Mentors New Zealand managing director Lisa Ford said the drop in confidence was expected.
"There's a nervousness out there in the marketplace, which you always get when there has been a change in government. We didn't have a clean change in government, either, which I think stopped people making decisions in their business," Ford said.
Changes to the 90-day trial period for employment, proposed increases to the minimum wage and paid parental leave would have also spooked small-business owners, she said.
"Small businesses are very tight on their budgets so any change is going to have an effect. Where organisations are looking to employ maybe two or three people, with that rise in minimum wage, then that will have an impact and they may only employ one."
Ford said she believed confidence would bounce back throughout the year.
"I'm hoping people will see change as an opportunity - it doesn't stop your business, you still need to plan ahead and continue to look at growth."