They raised the alarm, prompting concerned residents to rush out to begin a search.
A family friend found him unresponsive in the water about 12.45pm.
Coastguard, the Northland Rescue helicopter and Hato Hone St John all attended but he could not be resuscitated.
His death has been referred to the coroner.
Rosie Allen said her brother lived life to the fullest, “going 100 miles per hour” — trying to do, see and experience everything this world has to offer”.
Swimming, diving, fishing, and hunting were among his passions.
Life events in 2008 had led Allen to consider his own mortality. As part of this he penned some thoughts on his life and the people in it.
He told his children that he hoped they found the same passion for life he had.
He thanked his family and told them he loved them and hoped they achieved their dreams.
He shared his firm belief in doing good deeds and helping others, and being grateful in return.
Allen’s overarching message reflected the go-getter he was.
“I don’t know how anyone could get tired of life. There is so much to learn and enjoy,” he wrote.
Rosie expressed how his unexpected death was a reminder to others to pursue life.
“We are left here on Earth for however short or long our lives may be. We don’t know when our time is up.”
“Dan didn’t know.”
Rosie said her brother had been marinating pork to cook for the family that night and had been looking forward to a positive new year.
Holidaymakers staying at Bland Bay Campground held an impromptu sunset vigil for Allen at the water’s edge on New Year’s Eve.
A camper who took part said the vigil showed how many people cared.
The family said residents and visitors all honoured the three-day rāhui that banned swimming and seafood gathering.