Cowell, 56 and Miss Silverman, 38, only found out about the burglary when they were woken up by their personal minder. The bodyguard had been woken by an alarm.
"Obviously Simon and Lauren are really badly shaken by this," a family friend said. "It is a horrible violation of their privacy. But more than anything they are incredibly relieved no one was hurt.
"As upsetting as it is, Simon can cope with losing possessions as long as his family are safe.
"That is his one and only concern. Still, it's incredibly worrying and he is obviously going to review security."
The music mogul is worth more than £300 million for his Syco Entertainment company.
It is not yet known how the burglars entered, whether or not they deliberately targeted the mansion.
A spokesman for the Metropolitan Police confirmed the raid and said: "Police were called to an address in W14 on Friday, December 4 at approximately 02:20hrs to reports of a burglary in progress.
"Officers attended the scene but the suspects had left the area. Inquiries continue [and there have been] no arrests."
Cowell and his representatives were unavailable for comment. It is the second time Cowell's home has been the target of a burglary.
In 2012 the X Factor creator was watching TV in his bedroom at 10.30pm when he heard a "loud bang" in the bathroom on the first floor of his home - which at one time was the French ambassador's residence.
Entering the bathroom to investigate, he was confronted by a figure standing on the flat roof outside holding a rock above her head, with her hands covered in blood.
Police were called and found an intruder in a walk-in wardrobe adjoining Cowell's bedroom. Leanne Zaloumis was given a 12-month community order after admitting intent to damage or destroy property.
- Daily Mail