The committee said Wednesday Camp's conduct was "so manifestly and profoundly destructive of the concept of the impartiality" that he should lose his job.
It's now up to the Canadian Judicial Council to decide whether the recommendation should be taken to the federal justice minister, who has final say on Camp's fate.
Camp previously apologized for what he called his rude and insulting attitude.
"I'm very sorry that, on reflection and rereading what I said, that I intimidated her using facetious words," Camp told the committee in his testimony, according to CBC News.
Camp told the committee that "to [his] shame," he didn't realise his mistakes until his verdict was appealed, CBC News reported.
The 64-year-old judge said his words came from a "deep-rooted" bias "that all women behave the same way and should resist," CBC News reported.
"I wish I hadn't said them," Camp said, according to CBC News. "I can't guarantee that I'm not prejudiced in other areas. ... I have learned to be constantly vigilant against it."
Camp acquitted Alexander Wager in the trial, but a new trial was ordered.
Camp was a judge for the Alberta Provincial Court Criminal Division in Calgary when he made those comments against the woman. He became a federal judge last year and is at risk of losing his post. Federal judges in Canada may stay on the bench until they are 75.
Camp also apologised to his wife and daughter for the "embarrassment" he has caused them, CBC News reported.
"I recognise that I'd made a number of vulnerable people miserable. I was very unhappy with myself," Camp said. "The person I most want to apologise for is the complainant."
The woman, whose identity has been concealed, said the judge's remarks made her hate herself, according to media reports.
Camp's daughter, who said she herself is a rape victim, testified Thursday that her father's comments were "disgraceful." But she said she stands by him, according to CBC News.
Kim Stanton, legal director for the Women's Legal Education and Action Fund, told CBC News that Camp's comments represent a larger problem within the criminal justice system and will have a lasting impact on the public.
"It's terrible that sexist language was used; it's much more terrible that the public may have a perception that they will go into a courtroom and the judge won't apply the law," Stanton said.
Records say Camp, who grew up in South Africa and studied at the University of Stellenbosch, did not receive training or judicial education on sexual assault law in Canada and how to preside over rape trials.
During his testimony, Camp acknowledged his lack of knowledge about Canadian criminal law.
"My colleagues knew my knowledge of Canadian law was very minimal. It was nonexistent," Camp said, according to the Canadian Press. "Please remember I wasn't in this country through the 1960s, '70s and '80s. I was in South Africa, where we had other issues."
Camp moved his family to Calgary in 1998. His practice focused mostly on contractual, trust, oil and gas, and bankruptcy litigation. He was appointed to the Alberta Provincial Court Criminal Division in March 2012. He became a federal judge in June 2015.
- AP, Washington Post