WaiBOP United coach Peter Smith said the result would give his side a good wake-up call ahead of their next match in Dunedin.
"It is the kick up the backside that we needed I think, in the last three or four weeks we have done well. We've trained well and we spoke today before the game about complacency, that we still need to go out and work to control the game - it is not just going to happen.
"In football you don't just start where you left off last week, you've got to re-establish control of the game and I think today we thought that would just happen, and obviously the sending off changes things around."
WaiBOP United now have a record of one win, one draw, and four losses this season.
The club did record another win this season but unfortunately the result was taken off them for an administration error.
The first real chance came on 15 minutes on Saturday, when WaiBOP's Frederick Marquez turned on the edge of the box and was brought down.
Wylie stepped up to take the free kick near the edge of the 18-yard box and curled it inside the right-hand upright.
It was the first shot on target for either side and a well taken goal.
Hawke's Bay had a chance to equalise when Facundo Barbero ran on to an inch-perfect cross but WaiBOP keeper Danyon Drake made a good save.
Defender Ross Haviland then scored for Hawke's Bay, rising above the WaiBOP defence to head home from a corner.
A mistake at the back led to the visitors' second.
A WaiBOP defender was dispossessed and Barbero raced in on goal. He drew the goalkeeper and pulled a pass back to Sean Lovemore, who knocked the ball into the net.
After halftime, the tempo seemed to pick-up even further.
WaiBOP equalised after Fedrico Marquez hunted down a defender and stole the ball. He pulled a pass back to Jerahl Hughes who teed up Chad Coombes. Coombes hit the ball low and hard into the bottom corner.
The celebrations soon turned to despair though for WaiBOP, when Wylie was sent off a minute later. Hawke's Bay then started to build some good attacks, taking the lead on 72 minutes.
Lovemore scored his second of the afternoon when he went one-on-one with Drake and slotted the ball through his legs.
Ryan Tinsley then put the nail in the coffin, scoring his team's fourth after great link up play with Barbero. Tinsley slipped the ball into the bottom corner from 10m out.
- WaiBOP United (Craig Wylie 15, Chad Coombes 57) Hawke's Bay United (Ross Haviland 30, Sean Lovemore 41, 72, Ryan Tinsley 74
