The hot temperatures were caused by a warm, subtropical flow travelling from the northeast down New Zealand, which was exacerbated by warmer than usual sea temperatures.
Temperatures also got warmer as winds pushed the air over hills and mountains, in a phenomenon known as the foehn effect.
This effect was normally associated with northwest winds, but could also happen in northeast winds.
The heat has set in over much of the country but the South is bearing the brunt, with many places in the high 20s or low 30s around 3pm.
Dunedin city was showing 31.1C, Alexandra 30.5C, Queenstown 27.7C and Wanaka 26.2C. Of the smaller towns, Millers Flat was leading the way with 32.7C.
Several places in Canterbury were around 30C, while most of the North Island was enjoying temperatures in the mid to high 20s
A change may be in store, as MetService has warned Dunedin, Clutha and Southland residents to expect thunderstorms and possible hail this afternoon in the warm, humid northeasterly flow.
The focus of significant convection will shift from the North Island to the southern South Island, where daytime cloud build-ups are expected to produce isolated heavy showers (25mm or more an hour) or thunderstorms to parts of Dunedin, Clutha and Southland.
"There is a moderate risk of a few thunderstorms between Dunedin and Invercargill in the late afternoon and evening.
"If any thunderstorms do develop, they will be accompanied by brief heavy rain and possible hail in the 5mm-15mm diameter range.''
Yesterday, the so-called "Taieri microclimate'' was in full force as temperatures soared to 33.9degC at Dunedin Airport.
MetService meteorologist Tui McInnes said it was the third-hottest January day on record at the airport.
The official MetService thermometer at Dunedin Airport reached 30.1C at 11.30am, while Dunedin City was still struggling to reach 20C.
McInnes said the exaggerated difference between the two temperatures was common in the area.
Quite often when the region had warm, fine weather, the land on the Taieri heated up and caused air in the area to rise.
"When the air rises, something has to come in and replace it. So then we get cooler breezes coming from the sea.
"They only go a few kilometres inland, but they tend to drop temperatures in coastal areas [such as Dunedin City] because the sea surface where they come from is generally cooler.''
It was not until about 2pm, when the cooler sea breezes around the coast dropped, that the two temperature gauges started to meet, as Dunedin city headed towards 29C.
Invercargill again passed the 30C mark, but did not break its record of 32.3C, set on Sunday.
Alexandra, Balclutha, Gore and Wanaka also recorded highs of 30C or more; Queenstown came close with temperatures in the high 20s, and Oamaru recorded the lowest high of the day with just 23.7C.
McInnes said the high temperatures were caused by sunny skies and northeasterly winds.
"With these northeast winds, they have what we call a foehn effect. That's when the winds go over mountain ranges and, as they descend, they warm up.
"It's basically passing over all the hills and mountains on the South Island. That just really helps to exacerbate the warming.''