Police have said tasers had to be used on the 29-year-old who died in custody three days after his arrest, for the safety of the police officers involved.
Police have named the man as Alo Ngata, a 29-year-old from Tonga.
The investigation into his death and the circumstances surrounding the assault of the 76-year-old man are continuing after two police officers were forced to discharge their tasers during the incident.
Superintendent Karyn Malthus, Auckland City District Commander, said about 1pm on Sunday police were responding to reports of a man attacking an elderly man on Beresford St, Freemans Bay.
From the Eagle helicopter it was observed the 29-year-old kicked the elderly man in the head five or six times, essentially until he was unconscious, she said.
He then advanced on police in a threatening manner, she said.
The first two uses of the taser were ineffective, the second two were effective, she said.
"He continued to resist police attempts to restrain him, to cuff him.
"None of our police officers want to come to work and have to deal with this and have their shift end with the loss of a life.
"Any loss of life is tragic."
Police were called to the man's address the day before the incident and are reviewing that as well as part of the investigation, Malthus said.
Police had spoken with the deceased's family "to better understand what happened".
"Any death is a tragedy and we are working with, and supporting Mr Ngata's family, including his parents and wider family who are grieving their loss," she said.
The elderly victim is still recovering in hospital and is reported to be doing well.