Police said the suspect was located shortly after 5.30pm and taken into custody.
“Armed police staff currently have a presence in Wood St and the surrounding areas, however, there is no ongoing risk to the public.”
The supermarket did not answer the phone when the Herald called at 6pm.
A Foodstuffs spokeswoman told the Herald the man had been at a nearby business when he ran into the supermarket pursued by police.
The supermarket was evacuated for about 20 minutes. She said no supermarket staff were threatened and nobody was injured in the incident.
A shopper inside the supermarket - who had his baby strapped into a front pack on him at the time - told the Herald he was “pretty taken aback” by the situation.
“A lady on the intercom said that they were evacuating everyone immediately. Everyone looked around in disbelief, and then the woman repeated herself with more urgency in her voice,” he said.
He said the woman became more insistent over the intercom as people began to exit the building.
When the man left the supermarket, he said police armed with rifles began filing in.
As he was putting his baby into his car seat when he saw police bring a man out of the supermarket in handcuffs.
Supermarket customers took to social media this evening, saying everyone inside the supermarket was evacuated as police carrying rifles responded.
One commenter said police had earlier blocked the entrance to the supermarket and the Eagle helicopter was hovering around the area.