Twelve JP association presidents and registrars from all over New Zealand believe the Ministry has it wrong.
JP Raj Thandi, registrar of the Franklin association, said JPs existed to serve the public.
"If we do something against the public we should be outed for it, plain and simple," he said.
Long-serving JP Diane Yalden, of the Bay of Plenty, said "justices are supposed to be upstanding citizens.
"If you've done the crime you should do the time - and be named for it," she said.
For the past 200 years, JPs have been volunteering to serve the public by performing official duties such as verifying divorce papers, signing court affidavits or overseeing bail applications.
Every year about 70 complaints against JPs are lodged with the Royal Federation of New Zealand Justices' Association.
Most of these complaints are dismissed as frivolous, but on average four a year are deemed serious enough to be referred to the ministry for further investigation.
The federation has "zero powers to discipline" or publicly name JPs for misconduct, said national registrar Alan Hart.
Hart said he could not wade into the debate over identifying wayward JPs, but added it was "interesting" other professions, such as lawyers and doctors, had governing bodies with these disciplinary powers.
In 2007, amendments to the Justices of the Peace Act introduced disciplinary processes for JPs, including warnings, suspensions and removal from office for misconduct.
Any disciplinary decisions made under the Act occur behind closed doors at the ministry, but other western countries, such as Canada, have more transparent processes and JPs facing serious complaints front up at a public hearing.
Between 2011 and 2015, 18 complaints against JPs were investigated by the ministry, including false allegations, inappropriate language, insurance fraud, improperly witnessing documents, bankruptcy and the misuse of a title, according to information obtained under the OIA.
In half of these cases no action was taken because the complaint was either not upheld or it did not relate to the individual's role as a JP.
The Herald challenged the ministry's refusal to name JPs who had been disciplined, who resigned soon after a complaint or who had been removed from office and previously named publicly.
The Ministry responded with the names of the two JPs, Daljit Singh and Agnes Arti, who were forced from office by the Governor-General and had already been publicly identified.
Singh was removed from office in 2014 after being convicted for electoral fraud. Arti was forced from office last year after she admitted to insurance fraud.
The Ministry declined to name any others.
Jeff Orr, the ministry's chief legal counsel, wrote a letter to the Herald saying they would not identify JPs who resigned after a complaint because they no longer held office.
"Similarly I do not consider that the public interest outweighs the privacy interests of those who were rebuked for minor infringements," Orr wrote.
Four JP association presidents believed the discipline of JPs should be handled out of the public eye.
"Why would you want to offer your expertise to help the public if in the event of making a mistake you are going to be pilloried through the media?" asked Canterbury JP association president Ken Shields.
Leading administrative lawyer Graham Taylor, of Wellington, said JPs facing complaints deserved anonymity while they were investigated, but, if the complaint was upheld, he said, the JPs right to privacy should automatically diminish.
Complaints against JPs
• In Auckland in 2011, a JP was sent a letter of rebuke for writing a business letter in an "aggressive tone" that misused the title "JP" for personal gain.
• On the West Coast in 2013, a JP resigned after declaring bankruptcy following involvement in a property development that owed large sums to creditors.
• In Auckland in 2013, a community group called for the removal of a JP from office when he was arrested in India on terrorism charges. The charges were dropped and no action was taken.
• In Central Otago in 2013, a JP resigned from office after a police complaint about false allegations.
• In Auckland last year, a JP resigned after a complaint from a finance company about improperly witnessed loan documents.