"Their plea for victimhood, while at the same time for us all to save the planet as they jet around the world on their private jets. It's just not working."
The Sussexes had also been upset over Archie not being given the title of prince as well as being "cut off financially" after their move to the US.
Days after the tell-all, the Queen released a statement saying: "The whole family is saddened to learn the full extent of how challenging the last few years have been for Harry and Meghan.
"The issues raised, particularly that of race, are concerning. While some recollections may vary, they are taken very seriously and will be addressed by the family privately.
"Harry, Meghan and Archie will always be much-loved family members."