However Crofts told the paper while he knew she lived there before he moved in, he had nowhere else to live.
He said he also felt nervous when he saw her as he feared she would call the police.
Police have visited the man and encouraged him to move, but have no legislative powers to force him to relocate.
Crofts had been described by Judge Kevin Phillips a high-risk recidivist offender with limited controls and a strong sexual drive, the Times reported.
Auckland University law professor Warren Brookbanks said unfortunately it does not appear there is anything either the woman or the police can do.
"I can't think of any statutory power or statutory authority that she could call on that would require him to be relocated," Dr Brookbanks said.
He said the Victims' Rights Act does not allow victims to determine where someone who has served their time can live.
"Sadly the police are probably right.
"There's nothing in legislation that can require a person who is no longer under the control of state authorities to relocate simply because their presence doesn't suit another person nearby.
"They don't have that power, even though I can understand the anxiety that would generate from her point of view.
"If he does anything that is threatening or upsetting she would have remedy to in terms of making a complaint to police and they could pursue whatever charges were appropriate, but until he does anything like that I can't think of anything she can do about it."
Mr Brookbanks said while legislation could be changed to ensure cases like this do not happen, it would be difficult.
"There would be hails of protest from civil liberties' organisations saying the person has served their time, he is now a free citizen, he should be able to live where he likes, as long as he continues to obey the law.
"There would be difficulties if you tried to enact some provision, that said an offender cannot live next to his victim.
"And then the question is how far do you extend that restriction? Is it just the house next door, is it the whole street or is it the neighbour?
"It would be difficult to frame a provision which wouldn't unduly restrict a person's fundamental freedoms."
- Herald Online staff