Spicer painted a rather different picture.
"The president wanted to add to the team. I thought it was in the best interests of the administration not to have too many cooks in the kitchen."
While he was careful to insist that he had left on good terms, Spicer made little secret of his distaste for the journalists he faced during his months as spokesman.
"I was increasingly disappointed how people in the media do their job, or rather don't do their job," he said.
"They are not there for the facts or pursuit of the truth, they are there to see how do I get on TV or become a YouTube star," he added.
"More and more we are seeing it is about the clip and the click."
Spicer turned on what he described as the Washington DC bubble.
"There is a bias, there is a Washington mentality," he said.
Spicer not only had a rocky relationship with the White House press corps, but he was ridiculed mercilessly by satirists especially on Saturday Night Live where he was impersonated by the actress Melissa McCarthy.
"There are times when it goes from funny to mean. You have to have a little bit of a thick skin if you are going to do this," he said.
Appearing on the same programme, Reince Priebus, the White House Chief of Staff, denied that he was unhappy at Scaramucci's appointment.
"It is a good thing to start fresh. Sean gets to start fresh, Anthony gets to start fresh and the president gets to start fresh," he said.
"It is time to get the president the credit he deserves. This is a good day to start that process."