This was in spite of Jolly being charged less than a year before when he breached his extended supervision order and police found objectionable material on electronic devices at his home.
He had pleaded guilty to eight total charges and was given a sentence of two-and-a-half years' imprisonment by District Court Judge Gus Andrée Wiltens earlier this year.
However, he said the sentence was manifestly excessive and the judge displayed judicial bias by not allowing for a discount for his guilty plea.
Jolly's offending dates back to the 1990s and his criminal history includes more than 110 convictions for sex with underage girls, indecent acts, fraud, theft, assault and dangerous driving.
In 2004, he was jailed for sexual offending against a girl under 16 and doing an indecent act with a girl under 16.
At the end of his prison sentence, in December 2011, he was subject to an extended supervision order for 10 years and reporting obligations under the child sex offender register.
One of the conditions was to not posses or use any computers or electronic equipment capable of storing images - unless granted by his probation officer.
But, on August 8 last year, police visited Jolly's home.
They found a device plugged into the back of his television and took him away for questioning.
Jolly denied he owned the internet-capable device and then astonishing fled the police interview.
The next day police returned to his home and arrested Jolly, they also found a hidden cellphone.
On the phone were 3942 images and 20 videos.
Twelve of the images and videos were sent to and assessed by the Films, Videos, Publications and Classification Office. Eight were deemed objectionable.
Some of the images showed young women or young teens engaging in sexual acts, including one video depicting a woman being drugged and raped.
Prior to his latest offending, Jolly had 18 previous convictions for breaching his extended supervision order, including in 2014 when he used a smartphone to contact a teenage girl on Facebook.
Then in December 2016 his offending continued when he cut off his electronic monitoring tag and went on the run.
He was later found on State Highway 1 near Pegasus township, 25km north of Christchurch.
His extended supervision order conditions also ban him from going near schools, playgrounds and parks as well as associating with anyone under the age of 16.
However, mid-last year, Jolly was allowed to move into a Whangārei home within a kilometre of a children's health camp, a daycare centre, two primary schools and a high school.
Corrections moved him out of the address only days after he moved in - after neighbours identified him through the Sensible Sentencing Trust's online database.
In 2015, Jolly's history was highlighted by the Herald, which led to calls for an urgent review of the legal system.