In any case, the golf course is protected by cliffs and ocean along one side and more than a kilometre of farmland on the other.
Security staff checked the green before Mr Obama's group of six arrived in golf carts at the 13th hole, the only one clearly visible from a public road.
At one point Mr Obama could be seen putting his arm around Sir John's shoulders, but it wasn't clear if he was congratulating him for a good shot or consoling him after he hit a ball into a bunker.
Conditions were near perfect with sunshine, scattered cloud and a light breeze which picked up later in the day.
Few people live on unsealed Tepene Tablelands Rd and the few farmers at work were oblivious to the VIP teeing off nearby.
The former president's visit did, however, pull more national media than Northland has seen since Waitangi Day. Dozens of cameras were trained on the distant green in the hope of a capturing the 44th US president at play.
Kauri Cliffs wouldn't comment on yesterday's visit, with a spokeswoman saying ''our bottom line is that we don't talk about our guests''.
A 1.25 nautical mile no-fly zone was imposed over Kauri Cliffs until 5.30pm yesterday to keep the curious at bay.
Sir John has a handicap of 8 and Mr Obama revealed in 2016 that he had a registered handicap of 13.
Hitting the green with Mr Obama was former US Ambassador Mark Gilbert, who had returned to New Zealand for the visit.
Mr Gilbert said the trip would emphasise the growing relationship between NZ and the US.
"We struck up a friendship when he was a newly elected junior senator from the state of Illinois," Mr Gilbert said of Mr Obama.
He said Mr Obama "absolutely" still had a big influence on society, despite his removal from the political sphere.
"What he's really focusing on right now is the Obama Foundation and how they can teach young aspiring leaders to be the next generation of leaders around the world."
Mr Obama may hit the fairways for another game today, before heading back to Auckland for a private meeting with Prime Minister Jacinda Ardern. Next up was a 1000-guest invitation-only dinner at the ANZ Viaduct Events Centre this evening.