He is also facing two charges of attempted murder for his alleged attacks on another young child and a woman. He was found near the scene with injuries police believed were self-inflicted after the incident.
It is understood the woman is the mother of the children.
Douglas Cres resident Ian, who did not give his surname, said he woke yesterday to a police officer outside his house and a pool of blood “dripping into the gutter”.
“It’s a crappy situation,” he said.
“I think it was about 9am and [the police officer] was sitting on a seat and I saw the empty open medics bag, and the blood on the ground.
Ian said it was upsetting to “find out that it’s kids” who had been the victims.
“It’s just all kinds of messed up.“
Mayor of Hamilton Paula Southgate says she is “hugely saddened” by the incident.
“I am hugely saddened by the tragic and senseless death of a child and the harm to others.
“It is a tragic start to the year.
“My thoughts are with family, friends and the community of Fairfield,” she said.
Police said emergency services were called shortly after midnight to Douglas Cres after a report of an assault.
“When police arrived at the property, they found one person dead and two others seriously injured, who were transported to hospital.
“A 34-year-old man was found a short distance from the address with serious injuries and was also transported to hospital, where he remains under police guard.”
Detective Inspector Andrew Saunders earlier today confirmed that a baby had died, and another child and a woman remained in hospital in a serious but stable condition.
“The 34-year-old man remains in hospital in a stable condition under police guard and will be remanded in custody to reappear before the High Court in Hamilton, Tuesday, February 4,” he said.
“We extend our sympathies to the whānau at this tragic time and will provide ongoing support.
“A scene examination is ongoing at the Douglas Crescent property, and police are speaking with a number of people as they work to build a full picture of what has occurred.”
Saunders acknowledged it was a “distressing incident”, and the community is understandably concerned.
“We would like to reiterate that this was an isolated event and there is no risk to the wider public.
He said the alleged offender was found at a nearby property.
The last time he saw the injured woman she couldn’t breathe properly but was speaking.
Another neighbour, Kasey, said she and other neighbours helped keep the two uninjured children safe, wrapping them in blankets.
“[One child] was playing with a doll and she mimicked what she saw. The trauma that poor child has to live with.”
She said a nana and auntie arrived at the scene and “dropped to ground, screaming and bawling” after learning what had happened.
Anna Leask is a Christchurch-based reporter who covers national crime and justice. She joined the Herald in 2008 and has worked as a journalist for 18 years with a particular focus on family and gender-based violence, child abuse, sexual violence, homicides, mental health and youth crime. She writes, hosts and produces the award-winning podcast A Moment In Crime, released monthly on nzherald.co.nz