"We visited the home several times and were actively attempting to find mother and child. Despite this, we had been unable to speak with his mother or sight James to check on his wellbeing," said Mr Bennett.
Neighbours said a couple in their 20s or early 30s had moved in only a couple months ago. Te Pokuru Titoko, 19, who lives next door, said his family had occasionally helped the man who lived with James jump-start his car.
Mr Titoko said that on Monday morning he heard a woman scream, "What did you do? What did you do?", to which a man yelled back, "I don't know."
He said the woman then screamed, "I hate you, I hate you." A man replied, "Sorry."
An ambulance arrived shortly after, followed by several police cars. What seemed to be a gathering of the couple's friends and family took place on the front lawn, with more shouting.
A St John Ambulance spokeswoman said CPR was conducted but the 2-year-old died at the house.
A woman, whose property borders the Takitimu St house, said she had given James a puppy after he had seen them in her yard.
James' relatives have not been named, but Roxanne Ruhe has dedicated a song by pop star Bruno Mars to her "baby nephew James Joseph Ruhe Lawrence" on Facebook.
"When a child passes away, his/her soul goes straight back to God."
Contact police on 09 524 1925 or call Crimestoppers anonymously on 0800 555 111 with information.
INFANT DEATHS THIS YEAR
Mikara Reti: 5-month-old, Flaxmere. Suffered severe blunt-force blow and died on January 11. Trent Hapuku, 22, due to be tried for manslaughter.
Serenity Scott: 5-month-old, Ngaruawahia. Died on April 28 of severe, non-accidental brain injuries. No one charged.
Baby Afoa: 1-week-old, Otahuhu. Found in makeshift grave in Otahuhu on June 2. Mother Kulukora Akau'ola, 22, charged with murder. Christian Afoa, 29, of Mangere, admitted disposing of body.
Baby boy: 1-year-old, Otahuhu. Suffered serious head injuries, died on Nov 5. Police investigating.