"I couldn't imagine something like this happening in a million years."
He believed the mother was Romanian and the father is Indian and worked as a night receptionist at the Pembury Hotel round the corner for seven years, but apparently quit his job two days ago.
He confirmed the children were twins, a boy and a girl.
The girl remains in a critical condition in an east London hospital.
The Metropolitan Police said: "Detectives are urgently trying to trace a man who was at the flat shortly before the injured children were found, but left before emergency services were called. The man has not been seen since this time.
"He is Bidhya Sagar Das, 33, of the address in Wilberforce Road where the injured children were found.
"If any members of the public see this man or know his whereabouts, they are urged to contact police immediately.
"The incident is believed to be domestic. There has been no arrest at this stage and enquiries continue."
The National Police Air Service helicopter tweeted that it was assisting "officers searching Finsbury Park for a suspect".
A woman living opposite the building, who gave her name as Gui Gui, said she heard a woman shouting late last night and opened the window to offer help.
"I was watching TV," she said. "I heard someone was shouting. She kept on shouting. I do not know what she was shouting.
"I opened the window and I asked her 'Can I help you, can I call the police for you?' She added: ""I said what has happened and she just shouted 'my kids, my kids'."
The neighbour said she later saw two young children being carried out of the building, with one being held very close to a member of the emergency services.
