"New Zealand First certainly paid for that in 1999. And that time in 1996 people were asking for a change, too. In fact a lot of people supported New Zealand First in anticipation of that change."
NZ First was in a no-win situation, with "a lot of anguish" no matter what option was agreed upon.
"Should National end up in opposition, they would then spend most of the time planning to get rid of New Zealand First and its leader."
NZ First has said it is yet to agree on a governing framework. Possibilities include full coalition with ministerial positions inside Cabinet, a support agreement with ministers outside Cabinet and a confidence and supply agreement from the cross benches.
Another NZ First MP who missed out on a return after the election, Richard Prosser, said he believed a full coalition with ministerial positions inside Cabinet would be the wrong option.
"Collective Cabinet responsibility means you pretty much get forced to support bits of the other party's agenda that you otherwise might not."
Prosser said he believed NZ First would go with the left bloc if possible.
"Getting a fourth term is one thing. Getting a fifth term for the Nats is highly unlikely. And when they go down, if you are too closely associated with them then you may well go down as well.
"As far as the longevity of the party is concerned, I don't think they should take any ministerial portfolios. Because either choice is fraught with risk - on the National side that they don't come back for a fifth term ... the risk on the left side is the inherent instability of having the Greens there.
"Either way, if you take the portfolios then you are associated with that government. And if that government fails, you tend to fail with it."
Prosser acknowledged not taking portfolios could disappoint some NZ First MPs, and that could cause room for instability down the track.
Mahesh Bindra, another of the five outgoing NZ First MPs, said he didn't have a view on whether NZ First should side with National or Labour. He said NZ First followed a democratic process and a collective decision would be taken at today's board and caucus meeting.
"My experience has been even when my view has differed, once a collective democratic position has been taken then I have always stuck with it."