There are about 242 paedophiles nationally bound by the orders.
Wairarapa Rape Crisis counsellor Michelle Ihaka said it was a good idea to keep tabs on those who pose the biggest risk to the community.
"At the end of the day if it's what needs to be done to reduce harm to children then it's a good thing. It's about prevention so there is no repeat. I see it as being like a protection order ... it won't become an issue if they are doing the right thing and not re-offending. It's taking precautions."
Sex offending wrecked lives so anything that was a preventative was vital to ensure children weren't harmed, she said.
"These crimes are really really serious ... there will be some people who will say they have done their time and have changed but if they have changed it won't become an issue for them. People can be quite ignorant and think (the offender) won't do it again."
Confidentially and privacy should be waived when it came to sexual abuse against children, with neighbours of those who abused children kept informed so they could keep their own children safe, she said.
There needed to be a public list of paedophiles the community could access.
"We should be kept aware where they are living for the rest of their life. If people know they are living next door to them then they can put some measures in place for the kids.
"It's really frustrating when something happens and police say they have had a history.
"People can't protect their children if they don't know ... we are really behind in our laws when it comes to sexual abuse of children.
"It's an horrific crime ... we have such a long way to go."
Corrections Wairarapa/Manawatu district manager Garth Newman said public safety was top priority and staff worked closely with offenders ensuring they complied with release conditions.
Properties were checked to ensure they weren't in close proximity to places like schools and kindergartens frequented by children.
Notification of communities or neighbours was considered on a "case-by-case" basis, Mr Newman said.
"A significant amount of preparation goes into approving a suitable address for the offender to reside at. No address would be approved if it was considered that there was an undue risk to the safety of the community by having the offender live there."
Meanwhile, Ms Tolley said the bill wouldn't be passed before the next election.
If Labour wins the election it will be required to pass the bill into law before January to capture paedophiles already subject to the 10-year orders, due to expire.
Labour's Corrections spokeswoman Jacinda Ardern said she had been briefed by Ms Tolley on the legislation but the party wanted to listen to submissions before deciding whether to support it into law.
"It was Labour who originally assessed it was necessary in some particular cases for the safety of the community to enable that to happen and I imagine the evidence will suggest that is still the case. But we want to make sure we hear whether that is the case first."