"I'm no saint, for much of my first term I reflected on why I had come."
He went on to say the atmosphere in Parliament was often toxic, describing a "shrill" speaker and "loopy" committee chairs in the House.
He said that on his visits to Denmark and Sweden he had realised parliamentary debate could be ordered and respectful and "without narcissistic tone".
"Better behaviour and debate might encourage more members of the community coming here and making a contribution."
Mr Hayes said he often reflected on why our society was not more "generous and accepting" when people got something wrong.
"The media, especially, fall over themselves to beat up on anyone who buggers up.
"Why would anyone expose themselves to public life, when the risk of making a mistake exposes them to public pillorying?"
He said Parliament collectively paid a price by not providing an environment conducive to good leadership.
"We could move our country ahead further and faster by focusing on what's important but we bog down arguing with each other."
He gave the example of the irrigation scheme in Wairarapa, which had taken "over 10 years" to progress.
"It's a simple task but very little progress has been made.
"Were I New Zealand's next Prime Minister, I would ensure the next Parliament gets rid of a plethora of unnecessary legislation." He went on to say that Parliament could be rewarding for the right people but suggested Labour's Mr McAnulty did not have the experience.
"The Labour candidate dropped a leaflet in my mailbox the other day, proclaiming he should be my Member of Parliament because he had been MC at the Golden Shears.
"I have no doubt that requires skill but it's not the sort of thing that will make him a competent Member of Parliament, and I doubt the community will elect someone with so little experience and expertise," he said.
Mr McAnulty responded by saying: "If an outgoing MP feels the need to have a crack at the Labour candidate, we must be doing something right. Otherwise why would you bother?"
Mr Hayes also spoke of some rewarding experiences, in particular as head of the foreign affairs select committee.
During this time he hosted the first-ever Pacific Parliament in New Zealand, with 50 leaders from the region.
"There is satisfaction in seeing good outcomes and seeing common sense prevail."
He said the campaign to keep Makoura College open in 2006 was one of the most rewarding parts of his work as an opposition MP. "The outcome was a victory for the Masterton community."
He talked about his efforts to set up an air service between Masterton and Auckland, and his work helping Pasifika families get access to health care.
"Finally, can I say a thank you, all parliamentarians from all parties," he concluded.