"Why don't you get a real job where you earn some money?" Judge Cooper asked.
"If I were you, I'd be working at a fast-food joint so I could help support my kids."
The New York Post reported Phillips as replying: "It's not easy."
He claimed the ski trip was part of a weekend conference.
"That looks really, really hard," the judge cut in.
"I only wish I was suffering that way, spending time in Monaco, the richest city in the world.
"I want to see you start making some money."
The court heard that Phillips' only contribution to his children is taking them to art and swimming lessons.
His lawyer told the court that he would cover divorce-related costs by selling an East 52nd Street apartment, the Post reports.
Phillip's ex-wife, high-flying real estate broker Lisa Simonsen, declined to comment to the Post.
The parties are due back in court next month.
Phillips' Swiss-based PlantZap start-up company, which claims to reduce "the calorie and salt content of consumer products", is looking to build a processing facility in Queensland, Australia.
As company chairman, Phillips claims more than 30 years of experience in international banking, global finance markets and corporate finance, having worked in New York, London, Singapore, Sydney and Wellington.