The flat he lived at was closed up today, with the curtains drawn.
Denis Pike, who lives next door, had no idea one of New Zealand's most notorious offenders lived metres away.
"I didn't know about it. No-one knew. He wasn't telling anyone," Mr Pike said.
He said his partner would often bring her 5-year-old daughter over and other children would visit the flats, but nobody told him about the risk on their door step.
"He kept to himself mostly. I've only talked to him once."
Corrections says notifying the public about someone's past is considered on a case-by-case basis, although the situation with Livingstone remains unclear, as the department says it doesn't discuss individual cases.
In the block of flats at the rear of the property, Shane Simmons said he and Livingstone were quite friendly until Livingstone told him about his past - although he didn't volunteer the full story.
"I was shocked. I was really shocked when I heard it was a 10-year-old."
Mr Simmons then kept his distance.
"He liked to go for a walk downtown with me and a couple of times there I couldn't say no to him. I didn't want the public seeing me with him," Mr Simmons said.
"He used to come over here and have a chat and that. We'd talk about what sort of music he's into.
"He's right into his phone. He'd talk about his phone and what it could do and stuff like that. He likes his PlayStation, [it's] good to kill time. If you live on your own it's another friend I suppose."
Property owner Mark Goodwin, also didn't know about Livingstone's offending.
"I haven't got a clue. It came as somewhat of a surprise."
He referred NZME to his property management company.
A woman called Sue who answered Vesta Property Management's phone declined to comment.
Corrections lower north regional commissioner Paul Tomlinson said public safety was the "primary concern" when assessing accommodation.
"The suitability of a residential address for sex offenders is assessed on a case-by-case basis before it is approved by a probation officer."
Factors considered include proximity to victims, the type of risks the offender presents, and where they are likely to get the best re-integrative support to mitigate their risk," Mr Tomlinson said.
"A significant amount of preparation goes into approving a suitable address for a sex offender, and in particular, child sex offenders. This includes checking the property, as well as conducting a visual check of the neighbourhood for signs of children residing nearby, proximity of the house to schools, kindergartens, parks, swimming pools, libraries, thoroughfares and other places frequented by children."
An address would not be approved where it was considered that there was an undue risk to the safety of the community.
"We consider community notification for offenders on a case by case basis, in line with the Privacy Act, and taking into account any risk to specified individuals or with the offenders' consent."
Livingstone will appear in court tomorrow charged with breaching his release conditions.