Sarwar confessed that he could get into trouble for revealing the Prince's comments as protocol dictates that politicians should not disclose what royal family members have said to them.
He said: "I'm going to be in so much trouble for this because I don't think you are meant to tell private conversations!"
The future king has never publicly commented on the Netflix series but critics have suggested that the show's portrayal of the breakdown of his marriage to the late Princess Diana is "distorted and at times downright inaccurate".
Meanwhile, Charles' son Prince Harry previously admitted that he was comfortable with the popular show as it gave the public an idea of the pressures of being in the royal family, even if it isn't "strictly accurate".
In an interview with talk show host James Corden, the Duke of Sussex said: "They don't pretend to be news. It's fictional. But it's loosely based on the truth.
"Of course, it's not strictly accurate, of course not, but loosely it gives you a rough idea about what that lifestyle, the pressures of putting duty and service above family and everything else, what can come from that."
The Duke of Edinburgh, 73, was portrayed by Josh O'Connor in seasons 3 and 4 of the show, depicting Charles' young adulthood, including his early romance and wedding to Princess Diana.
O'Connor's portrayal resulted in him winning a 2021 Emmy for Outstanding Lead Actor in a Drama Series.
People magazine has reported the role of Prince Charles will be taken over by Dominic West for The Crown's final two seasons to show the character's relevant age.
- Additional reporting by NZ Herald