Binse once said he would never surrender if confronted by armed police during a robbery.
In one interview he said he was an armed robber "for the excitement, the rush ... f*** the money. It's more than excitement, it's an addiction".
This morning police could be heard shouting at the gunman moments before making the arrest, demanding he "put the gun down''.
Yesterday a woman who was not being held hostage emerged from the house and was treated by paramedics.
Later in the day police said they would like to bring the operation to an end because of the "immense'' impact on the community.
More than a dozen families were forced from their homes and the nearby major road Keilor Park Avenue was closed.
Binse has been hardened by a life of crime, his notoriety increased by a penchant for publicity, taunts, jailbreaks, media interviews and prison reform, at one stage enlisting the New South Wales Greens to support demands for better conditions for prisoners in Goulburn maximum security prison.
He ran away from home at 13, after his mother found a new partner, was made a ward of the state, but found himself on a downward spiral after stealing cars, repeated terms in juvenile detention and, finally, at 17, jailed at Melbourne's notorious - and now closed - Pentridge Prison where Ned Kelly's bones were reburied in 1927.
He was named Badness in Pentridge: "It was just, you know, there was good, there was bad, there was badder, then there was badness. Badness stuck."
Binse became a serial escaper: from a prison hospital in 1992 using a smuggled gun, and from Sydney's Parramatta Jail only months later, cutting through bars, jumping from roof to roof, sliding down knotted sheets and running as a guard shot at him.
A year later, he was involved in a failed plot to escape Pentridge with 30 other maximum security prisoners and was shackled in leg irons and handcuffs, and, after being released in 2008 on parole, was sent back to jail within nine months for possession of a Taser and another weapon.
He bought a Queensland property with stolen money and called it "Badlands", drove a car with the personalised plates "Badness", sent greeting cards to detectives while on the run, and took out a classified advertisement in the Herald Sun saying: "Badness is back".
Binse issued a writ against the Victorian Government for failing to protect him from other, knife-wielding, prisoners, complained he had been prevented from attending rehabilitation courses, and, in NSW, conducted a survey of 150 inmates to support claims that conditions at Goulburn violated United Nations rules on the treatment of prisoners.
But he did have regrets. Binse told the ABC he did not realise the extent of the trauma he had inflicted on his victims, and that looking back, his life had been a waste: "What a silly person. I think of myself, what an idiot."
LIFE OF CRIME
* Career criminal Christopher "Badness" Binse, 43, fled to a suburban Melbourne house after pulling a gun on police at an Italian restaurant on Sunday night.
* Binse has spent most of his adult life in jail, committing at least nine armed robberies and escaping jail as many times.
* Ran away from home at 13, spent several years in juvenile detention before graduating to serious crime and Melbourne's notorious, now-closed, Pentridge Jail.
* Claims lack of education and training in prison, and denial of rehabilitation courses, fuelled his downward spiral by leaving him only with survival skills useless in finding work on the outside.
* Now under siege for the past two days, firing 12 shots but surrounded by heavily-armed police with no chance of escape.
* Police have set up camp outside the Melbourne house.