The escapee, who faces a serious sexual violence charge, is in custody and has been remanded without plea. He will be back in court next month.
Other information surrounding the case, including when and where the alleged crime occurred, can't be revealed as it could identify the man.
Sexual violence survivor and advocate Louise Nicholas told the Herald that if the charges were proved, Corrections had failed the woman and the community.
"I just hope that she has the support and wellbeing wrapped around her and that anything like counselling is provided for her ASAP. I hope that that is happening now, but not at her expense."
She said police needed to make sure the survivor had the right support for the upcoming court hearings.
Nicholas also hoped Corrections would undertake an external inquiry into how the escape happened and look into whether people in prison were getting support from staff.
"Is it a staffing issue, is it that our staff aren't trained enough?"
In a statement, a spokesperson for Corrections told the Herald the organisation was carrying out a number of ongoing reviews into the incident.
"Including a full operational review by our Chief Custodial Officer with independent assistance from former New Zealand Police Superintendent Grant O'Fee, MNZM.
"This escape should not have been able to occur, and we have made immediate changes to security and operations at the prison concerned. We take full responsibility for our part in this and where we identify failings, they will be remedied with urgency."
They said while the matter was before the court there were limits to what further information or comment they can provide.
"This is because we are unwilling to prejudice the outcome of the ongoing court proceedings which could jeopardise the man from being held to account for the crimes he is charged with."
Sexual harm - Where to get help
If it's an emergency and you feel that you or someone else is at risk, call 111.
If you've ever experienced sexual assault or abuse and need to talk to someone, contact Safe to Talk confidentially, any time 24/7:
• Call 0800 044 334
• Text 4334
• Email support@safetotalk.nz
• For more info or to web chat visit safetotalk.nz
Alternatively contact your local police station - click here for a list.
If you have been sexually assaulted, remember it's not your fault.