They cannot have a funeral, they cannot mourn with whānau but at the very least they want baby's ashes home with them.
Technically, the officer explains, they are breaking the rules.
But after speaking to them further he decides to let them travel on.
Since March 26, much has been made of police powers and discretion when it comes to what people can and cannot due under the lockdown rules.
But when you see it in action it's clear that officers are making good decisions based on unique circumstances during an unprecedented time.
"You have to have compassion - let them know that technically they are breaking the law, but apply a bit of common sense," says the officer.
"Only one of them should have driven to get the ashes - maybe two so they had emotional support.
"They shouldn't have taken the kids but what else could they do with them? And the kids are grieving, too.
"It's all right writing the rules down but they just don't cover every scenario we're going to find out here."
Earlier this week, new police Commissioner Andrew Coster - who marked a week in the top job yesterday - announced there would be checkpoints across the country over the long weekend.
The fear was that people would try to scarper to baches and holiday homes for an Easter "break".
Aside from the potential of spreading Covid-19 by travelling, there is the huge risk of crashes that would necessarily tie up already stretched emergency services and frontline hospital staff.
"We know many New Zealanders may have been planning to catch up with friends and family this weekend or travel to traditional holiday destinations but we urge anyone who was planning to do this - please change your plans and stay home," he said.
"To help ensure people know about the Health Act restrictions, police will be out and about checking that people are travelling for essential purposes only.
"It's simple - travelling to and from different towns and cities risks spreading Covid-19 and puts lives at risk."
The Weekend Herald spent the morning at a police checkpoint yesterday, Good Friday, speaking to police tasked with enforcing the lockdown rules and hearing from people about why they were out.
"The main things we are seeing in terms of people not being compliant is groups of people heading off to the supermarket or going shopping when really one person should be doing that job," he said.
"We had one person making his way up from Orewa, which is 20 minutes away from here [the checkpoint], to take his dog for a walk at Omaha.
"We were wondering whether the beach in Orewa was still there…"
Wallace said most people stopped were on their way to buy food and supplies.
"There's usually just one person in the car," he said, approvingly.
"We use a graduated response - engagement, education and then enforcement - and most people are very supportive we are out there doing this, they want to see us out there enforcing it."
As the lockdown - in place for at least four weeks but open to extension - passed the 14 day mark, the number of cases of new coronavirus patients was dropping.
In fact, even after the long weekend there will be checkpoints and vehicle stops happening regularly.
"The number is tracking down but we cannot get complacent," said Wallace.
"It's like a game of rugby - getting into the halftime break with a big lead; you want to come out for the second half and still play hard and strong.
"You can only do that and win if everyone plays their part."
Wallace said times were challenging for police and the public and he was proud of how both sides were pulling together to make it through the pandemic and save lives.
"We want to keep the foot on the throat though, we don't want to be complacent," he said.
"But of course we have to use common sense - the Government set out what people can and cannot do but that doesn't cover every eventuality so we've just got to apply a little common sense.