Lawyer Tony Ellis said the ombudsman's latest declaration meant there was "plainly" a civil case to be made under the Bill of Rights Act if the family decided to take one.
However, in an interview with the Herald, Judge Boshier said he was hoping those in power would do what was needed for Ashley without legal action.
"It is a difficult case. But the nature of society is that we have people who are complex. We have to rise to the challenge. That's the measure of a society that acts with humanity," he said.
After Judge Boshier first declared Ashley's treatment in breach of the Convention of Torture, in April, Capital & Coast District Health Board accepted the report without argument.
Following interest from the Herald last month, it sought leave to give extra feedback, highlighting his complex needs and tendency towards violent outbursts.
In a press release on Friday, it said the media had "overstated" Ashley's level of seclusion.
Associate health minister Sam Lotu-Iiga agreed, and said it was important to take the health board's feedback into account. He said he had been reassured Ashley was being cared for "in the best way possible".
Judge Boshier said he disagreed the situation had been misreported.
"Our reporting is meticulous. Our Crimes of Torture Act inspectors are the experts in this. What we have done is accurate and what [the Herald] have done has been accurate," he said.
"I have listened to what the response from health board was and I think it's a little precious. A more helpful response would be to acknowledge the problem and do something about it."
Judge Boshier is planning to meet with Ashley's parents, Dave and Marlena Peacock, later in the month.
What does the law say?
• New Zealand has ratified the United Nations Convention against Torture and Other Cruel, Inhuman or Degrading Treatment or Punishment.
• Several organisations are designated to prevent and monitor the convention, including the Ombudsman, which has Crimes of Torture Act inspectors to inspect places of detention - including secure mental health facilities.
• They are empowered to make recommendations to the government aimed at strengthening protections, improving treatment and conditions, and preventing torture or ill-treatment.
• The New Zealand Bill of Rights Act 1990, also includes the right not to be subjected to torture or cruel treatment.