In 2002, Kelly was indicted on 21 counts of child pornography. He pleaded not guilty and was acquitted of all charges in 2008. Most recently, Kelly was accused of holding young women in a "sex cult".
Radio station Flava has since withdrawn it support for the New Zealand show, thanking the public for their feedback.
Victims' advocate Ruth Money and the Women's Refuge have slammed Kelly's upcoming show.
"This is disgraceful," Money said.
"Given all the calls this week from the community about respectful consensual relationships - how can this man be allowed a platform to entertain Kiwis?
"This is not the kind of role model our young men need," she says.
"This country has signalled enough is enough and now we see this bollocks."
Women's Refuge chief executive says Kelly's visit is problematic considering New Zealand's "serious problem" with violence against women.
"New Zealand's got a really serious problem with family violence, with violence against women in general," she says.
"The presence of someone with a history - albeit with no convictions - but a decades long history of predatory behavior and violent behaviour, I don't think he adds anything to our country.
"Popular culture has an immense amount to do with shaping the way people think and the way people behave, and the sort of role models that we hold up, particularly to our young people.
"And when we've got somebody who does this sort of stuff, just because he's got money, and just because he's famous... he needs to be thinking about some of the damage that he's done."
Jury says allowing Kelly into New Zealand sets a bad example for men.
"It stops the conversation about changing behaviour, and it calls into question the need for change for some men," she says. "There's been no indication that (Kelly) sees anything wrong with his behaviour."