Also missing from the safe was a quantity of costume jewellery and other jewellery, while it is thought the only other item stolen in the burglary was a 37in Panasonic TV.
"It's a collection my father and myself put together over 75 years," the victim said.
It focuses on "full face queens" and includes one of the first stamps used in New Zealand, an 1855 penny red.
"They're obviously of sentimental value, but they're also of historical value," the victim said, adding it would be almost impossible to sell.
"My big concern is that it is just going to get dumped somewhere, and lost forever."
"Obviously I would like it back, but I particularly don't want it destroyed."
Constable Jane Callaghan, of Hawke's Bay Police, said: "The victim is distraught about the loss of his historical and sentimental stamp collection."
Police are investigating the burglary and require assistance from the public to return the stamps to the rightful owner, and are also seeking sightings of the people responsible for dumping the safe sometime between May 3 and May 6 at the Tukituki River near Haumoana.
Anyone with information should call (06) 8366196 or contact police through Constable Callaghan on (06) 8730500 or the confidential crime line 0800 555111.