The couple instructed him to do outdoor tasks, including mowing the lawns and washing the windows, but had not instructed him to do any work inside the house.
The caregiver said he was not given a list of tasks to carry out and, because it was raining, he could not carry out work outside.
He called the co-manager of the family's other farm to ask what he should do, and was told to do chores inside.
The caregiver claimed to have carried out cleaning work, including stripping the couple's bed and washing, drying and folding some laundry.
When the family returned home in early January, none of the outdoor work had been done and the house was untidy, with the bed unmade and several dead flies scattered about.
The couple claimed the caregiver had been living in their house and entertaining guests, including another man who was seen near the property.
They also alleged he had slept in their bed and taken drugs inside the house.
A confrontation unfolded, with the boy's mother calling the caregiver "disgusting" and a "f***ing faggot". She also made a limp-handed gesture, which the ERA said was offensive to gay men, and mocked him for crying.
The couple demanded he repay his wages, and boxed in his car with a tractor until he had arranged payment.
The caregiver, who said he felt "scared" after 20 minutes of confrontation, told them he would call his bank, but instead called police.
The ERA found some of the couple's claims were "fanciful" and agreed the caregiver had been sexually harassed and constructively dismissed.
It noted the woman's claim she was not homophobic - and suggested she would be "well advised" not to use the language or behaviour she admitted to.
The ERA reduced the amount of compensation it awarded the man because he had violated the couple's privacy by entering their bedroom without permission.
It ordered the couple pay him $13,571.56 in total, including lost wages and costs.