It didn't stop him playing four tests and 33 one-day internationals for New Zealand in the early 1990s, as well as 33 games at fullback for the Canterbury rugby team (1980-85).
Latham spends a fair bit of time on the golf course these days. He has a 3.5 handicap and plays most Saturdays but his main focus is his work as general manager of the Harewood Golf Club in Christchurch.
Last year, he was named Administrator of the Year at the Canterbury Golf Awards and was also a finalist for Canterbury Sports Administrator of the Year.
When Latham took over in 2007, Harewood was cash-strapped and owed money. Christchurch airport approached them in 2009 about buying some land to extend the safety area around the runway and Latham negotiated a sale of 46 hectares (the airport initially wanted 11) for $7.5 million.
The club still have 27 holes - they lost nine - and the money has allowed them to undertake a redesign overseen by former professional Greg Turner. Harewood has a membership of 850 and hosts the final Charles Tour event each year in October.
Latham doesn't necessarily see himself involved in golf for the rest of his career.
"I would love to get to a stage where I run a sporting franchise but there aren't many opportunities in that, especially in Christchurch," he said. "I have also thought a lot about being a cricket match referee."
New Zealand's position is presently held by former captain Jeff Crowe - referees must be former test cricketers - and Latham is aware many others would covet the position if Crowe stepped away. It would also prevent him from watching son Tom, an opener for the New Zealand team, as often as he would like.
Sport has dominated Latham's working life. He worked in a sports shop during his playing days and was a sponsorship manager for DB Breweries.
One of his biggest challenges was to convert Richard Loe from drinking a rival beer but a few dozen left on Loe's doorstep soon convinced the former All Black prop.
Latham then worked in corporate hosting before being shoulder tapped to become sponsorship manager of Canterbury Rugby.
He admits his name helped open doors - his present job was the first he had to apply for - but in time it's possible he will be known as father of rather than Tom being son of.
Latham is a keen follower of Tom's career, which has meant a number of sleepless nights on the current West Indies tour, and he's happy to watch from afar. He helped coach his sons as youngsters (Matt went on to play indoor cricket for New Zealand) but didn't like to interfere in their formative years.
"It's nice to be remembered but it's hard on the kids so I stayed in the background as they got a bit older," he said.
"I don't get nervous watching any more. I used to get very nervous as a player but I have now realised I can have absolutely no influence on a game."
Not now, anyway.
