Jen Martin, a IT programme manager from Nottingham, said: "Any chance Andrew Castle could cut out the horribly creepy and sexist remarks?"
Henna Khan-Hussain, a broadcaster and voiceover artist from Harrogate, described the comments as "really bad, patronising, rude, just embarrassing", while Steph Driver told him to "stick to the tennis".
Samuel P J Whitwell, a writer and musician from Leicester, said: "Awful. Barry Davies and David Mercer the only men who can be relied upon to just call the match and not mention looks."
Castle, a former Grand Slam finalist who has appeared on Strictly Come Dancing, initially hit back at his critics, stating on Wednesday: "Brilliant. I knew there would be someone who would comment. Earnest, humourless and probably no fun at all."
But by Thursday morning he appeared to be in a more conciliatory mood, posting a Tweet in which he apologised, saying: "Obviously never mean to upset anyone. If I did then I apologise."
The BBC said it had received a number of complaints from viewers about Castle's comments but would not comment on whether it had instructed him to apologise.
Ms Bate, a former Miss England contestant with two young children, has bridled at suggestions that she is simply the latest in a long line of glamorous Wags photographed to be on her boyfriend's arm.
She emphasised that she has a career in her own right, pointing out on Twitter that she is a qualified dental surgeon who studied at King's College London's GKT School of Medical Education.
"I'm Dr Jennifer Bate, who spent 5 years at GKT London, after 10 A* GCSEs & 5 A-levels," she said.
At the same time John McEnroe, three times Wimbledon winner, has been accused of being rude and patronising about Willis, the world number 772 who lost in straight sets to Federer but won thunderous cheers from the Centre Court crowd for his determined performance.
During the match McEnroe appeared to dismiss Willis as a "club player" who could not expect to fit into the elite surroundings of the Grand Slam tour. He also referred to the Slough-born player's previous drinking habits.
Willis, 25, admits he went through a period three years ago when he drank a lot and found it hard to motivate himself to train and compete.
But Willis' coach Matt defended his player, saying: "I think John missed the point completely and clearly hasn't done his homework. Willis has been a lot higher ranked. Disappointing and completely the wrong tone."