Green was enjoying a walk on the resort yesterday as Sky News and the Daily Mail tracked down the billionaire at his home in Arizona.
Wearing a T-shirt and shorts along with a white towel over his shoulder, Green tried to grab a Sky News producer's mobile phone as they recorded the incident.
Green said: "You need to leave."
He added "Can you go away?" and "I believe you're being intrusive."
Sir Philip then turned around and got into a golf buggy before driving away as a member of staff got between the reporters and the billionaire.
On Thursday night the Guardian claimed Sir Philip paid huge sums to some of his accusers in order to stop the allegations becoming public.
Among some of the serious claims put towards him include Green calling women "sweetheart", "darling" or "love" instead of their names and also calling other female employees overweight.
He is also alleged to have crept up behind women in the corridors and touching staff members awkwardly.
The 66-year-old is also claimed to have gone into meeting and asked if there were any "naughty girls: that "needed their bottoms slapped".
In a statement after he was named in parliament as the businessman behind an injunction against the Daily Telegraph, he said: "I am not commenting on anything that has happened in court or was said in Parliament today.
"To the extent that it is suggested that I have been guilty of unlawful sexual or racist behaviour, I categorically and wholly deny these allegations.
"Arcadia and I take accusations and grievances from employees very seriously and in the event that one is raised, it is thoroughly investigated.
"Arcadia employs more than 20,000 people and in common with many large businesses sometimes receives formal complaints from employees.
"In some cases these are settled with the agreement of all parties and their legal advisers.
"These settlements are confidential so I cannot comment further on them."