There have been 32 privacy breaches at Inland Revenue involving 6,300 people in the past year.
Revenue Minister Peter Dunne says it came as a very big shock to him.
He says he's not happy with any breaches.
"But we deal with 25 million transactions a year so 32 breaches out of 25 million is a pretty small number, but frankly to my way of thinking - one breach is one too many."
Mr Dunne says he's very sorry to anyone who's had their information compromised, and he says he got guidance from the office of the Privacy Commissioner about 5,700 of those people.