The Focus actor - who has children Trey, 22, from a previous relationship, and Jaden, 16, and Willow, 14, with wife Jada Pinkett Smith - finds it "weird" that people think he is sexy and insists there are other actors who are much more hunky.
He said: "It really is it's a strange thing to be considered.
"When I think sexy, I look at Denzel (Washington)...Now that's a sexy man! You know, I never thought of myself in that way, so it's fun."
The 46-year-old star claims he was a "late bloomer" who only saw his physique change in his late twenties.
He told talk show host Ellen DeGeneres: "I was a late bloomer. Probably right around 26 or 27 years old, I started to fill out a little bit...I've always been skinny...But, I grew into my ears, I guess you could say."