Yi minutes later tweeted that she knew Cross wasn't joking at the time.
Yi added that the incident left her near tears.
A Twitter user later asked Cross if he would like to respond to Yi's allegation.
The Arrested Development star later posted a note "to any and all" on the matter on Twitter.
"This accusation from Charlyne took me by surprised (sic) and was deeply upsetting. I would never intentionally hurt someone like that," Cross tweeted to his roughly 116,000 followers.
"I do not remember doing this when I met her. I do remember meeting her though. She was the then girlfriend of a good friend of mine and we were about to start working on a movie together.
"I am NOT accusing Charlene (sic) of lying and I'm truly sorry if I hurt her, it was never my intention to do that," he added.
Cross said he doesn't recall their meeting the same way Yi does and claimed he reached out to her in an effort to resolve the discrepancy.
"Anyway, I can't believe I have to write this but I am not a racist nor a bully and loathe them in real life #rashomon," Cross wrote at the end of his note.
Rashomon was a reference to the 1950 Japanese film by Akira Kurosawa that offered contradictory viewpoints of the same story.
Yi in follow-up replies said she didn't want to be introduced by Cross at a later Girlfest event due to the incident.
"Like I said before, it's been a decade and I hope he's changed by now," she also tweeted about Cross who voices the Master Crane character in the Kung Fu Panda franchise.
Cross can be seen later this year in the historical drama The Post about the publishing of the Pentagon Papers.