The cost of postponing a trial can run into the thousands of dollars in lawyers' fees, witness costs and court time wasted. It also places added stress on witnesses.
Figures from the Ministry of Justice show that out of the 219,963 people summonsed for jury service last year, nearly 45,000 - about one in five - failed to show up.
Judge Harvey said it was important that cases were decided by a panel made up of people from all walks of life.
Judges can impose a $1,000 fine on people who refuse to turn up to court for jury service, but Judge Harvey said that was a last resort.
"No judge would like the prospect of imposing a penalty, but unless attendance rates improve, that may be a possibility."
The penalty has been imposed only once - in 2007.
Judge Harvey was asked if jurors' remuneration could play a part on non-attendance. He said he could not comment.
Ministry of Justice general manager of courts Tony Fisher said there were no plans to look at the remuneration rate of $31 per half-day.
But he said jurors had their bus and train trips, or their parking fees, paid for. They also got morning tea, but got meals only when deciding verdict.
What jurors get
• For each half-day: $31
• If at court between 6pm and 9pm: $89
• If at court after 9pm: $127
• Rates increase if jurors serve more than six days.