During his own career, the versatile, larger than life actor most notably played Uncle Phil to Smith's Philly newcomer in the beloved show, as well as working on a number of TV and film projects up until he fell ill this year.
TMZ reported that the actor died suddenly in an Los Angeles hospital on New Year's Eve from complications following open heart surgery.
Avery, who also suffered from diabetes, had recently undergone surgery for an undisclosed illness and took a turn for the worse late on December 31.
They added that his wife of 15 years, Barbara, had briefly left his bedside to get food when he passed away.
His mother Florence Avery told the New York Daily News: "It breaks my heart. My child was a great person who helped anyone he could. He was really just a nice person whose great passion in life was reading."
Alfonso Ribeiro, who played Avery's on-screen son Carlton on the show, was quick to share his thoughts on the tragic turn of events, writing: "I'm deeply saddened to say that James Avery has passed away. He was a second father to me. I will miss him greatly."
While it may have taken co-star Smith several days to react publicly, his wife, Jada Pinkett Smith, with whom he celebrated his 16th wedding anniversary the same night of Avery's passing, wrote on Facebook: "Happy New Year everyone! I was hoping to start the new year differently but we have lost yet another friend. James Avery who we all lovingly know as Uncle Phil from The Fresh Prince has passed.
"Our condolences to aunt Florence (his mother), Miss Barbara (his wife) and all those who loved him. Rest in peace James."
Tatyana Ali, who played James' on-screen daughter Ashley Banks in The Fresh Prince, also paid tribute to the late star for being her "protector".
She wrote on Twitter: "James was my teacher my protector & the most magnificent actor. We're feeling his loss very deeply. He'll always be apart of me #JamesAvery (sic)."
His uptight, stern Fresh Prince character, Philip Banks, was so iconic, he was ranked No. 34 in TV Guide's 50 Greatest TV Dads Of All Time.
He also provided the voice of Shredder in the original Teenage Mutant Ninja Turtles television series, as well as War Machine in the animated series Iron Man and Junkyard Dog in Hulk Hogan's Rock 'n' Wrestling.
Avery also played Michael Kelso's commanding officer at the police academy late in the series run of the popular sitcom That '70s Show.
He last filmed in Zach Braff's upcoming film Wish I Was Here last September.
The former Scrubs star paid tribute to the actor, tweeting: "James Avery was a very funny and smart man. He did a cameo as a favor to me in WIWH and had the entire set rolling with laughter. RIP."
Avery, who was born in Atlantic City, New Jersey, recently filmed Valediction and stared in Grey's Anatomy.
The Vietnam War veteran lived in Longport, New Jersey.
- Daily Mail