Being given his silver tray, alongside 14 other retiring MPs, had been a special experience.
"I've been to eight of those silver tray presentations previously, so I knew what I was in for," he said.
"But it really was something special."
In February, Mr Ryall announced he would not be returning to Parliament. Instead, he is opting for a new career and a new challenge within the private sector.
"At the moment I am just looking at taking a bit of a break and having a family holiday then I will be looking for some new work."
David Lange and Sir Robert Muldoon were still in Parliament when Mr Ryall was first elected. Sir Robert invited him for dinner, where conversation quickly dried up and the two ate in silence.
When leaving, Sir Robert told him: "That was really good, let's do it again sometime."
During his valedictory speech, Mr Ryall spoke of National's successes in raising child immunisation rates and increasing elective surgery. He listed the "mega-trends" which would shape the health sector in the future.
After announcing his retirement from politics several months ago, he had become used to the idea of no longer working in the Beehive.
"My time here has been fantastic ... I have learned a lot."
He said it was great seeing so many new MPs taking the helm.
"My advice ... I have two things to say, work hard and appreciate the value of your team."
Tony Ryall's parliamentary career
• Minister in Charge of the Audit Department: December 8, 1997, to August 26, 1998.
• Associate Minister of Justice: December 8, 1997, to January 31, 1999.
• Minister Responsible for Radio NZ: December 8, 1997, to January 31, 1999.
• Minister for State-Owned Enterprises: December 8, 1997, to Dec 10, 1999.
• Minister of Local Government: August 31, 1998, to January 31, 1999.
• Minister for Youth Affairs: August 31, 1998, to December 10, 1999.
• Minister of Justice: January 31, 1999, to December 10, 1999.
• Minister Responsible for Housing New Zealand Ltd: January 31, 1999, to December 10, 1999.
• Minister of State Services: November 19, 2008, to December 14, 2011.
• Minister of Health - Current.
• Minister for State-Owned Enterprises - Current.