Hutt Valley Police are searching for Jonathan Joshua Antipas, 24, who may be holding a woman against her will, along with their five-year-old son.
Police said Antipas is alleged to have yesterday unlawfully entered a property in Upper Hutt with a firearm trying to find Kyrstin Wichman.
She was not at the address and has subsequently disappeared.
Police have fears for her safety due to his agitated state and access to firearms.
A warrant to arrest has now been issued for breach of release conditions.