The pair will meet again more formally tomorrow morning New Zealand time.
New Zealand ambassador Mike Moore and his wife Yvonne were also on hand to greet and farewell Mr Kerry.
On his way out, Mr Kerry commented to New Zealand reporters that he had visited Wellington in 1968 and much he had enjoyed going into the mountains.
"It was absolutely beautiful."
He was 25 at the time and taking some "R and R" from fighting in Vietnam.
He later became an anti-war activist.
Assistant Secretary of State for East Asia and the Pacific Danny Russel was there, too, as was Australian Ambassador Kim Beazley.