Bayly received 14,296 votes, well ahead of Costello who received 2864 votes.
Although Costello didn’t receive the electoral seat, she will still be in Parliament as she won a seat through the party list.
Bayly and Costello have both been made ministers in the new Government.
Costello is Minister of Customs, Minister for Seniors, Associate Minister of Health, Associate Minister of Immigration, as well as Associate Minister of Police.
Bayly is a Minister Outside Cabinet receiving the portfolios Commerce and Consumer Affairs, Small Business and Manufacturing, as well as Statistics.
He said becoming a minister was “a proud moment” for him and his family.
“Now the hard work begins.”
Bayly was first elected to Parliament in 2014. He was born in Whanganui into a farming family and qualified as a chartered accountant.
Formerly an Officer in the New Zealand Territorial Army and British Parachute (TA) Regiment, Bayly has a long-standing love for sports and competed in three Coast-to-Coast events, marathons and Ironman events.
He is also a keen mountaineer having scaled four mountains in Antarctica, amongst others.
The by-election was sparked by the sudden death of Act candidate Neil Christensen and was held on November 25.
The 18,815 cast votes included 87 disallowed votes, 495 special votes, including 66 overseas votes, and 66.7 per cent of all votes were cast in advance.
All votes cast on and prior to the election day have been recounted. Special votes have been checked for eligibility before being counted.
The Port Waikato by-election had a higher voter turnout than the Hamilton West by-election in 2022, which was sparked by the resignation of Dr Gaurav Sharma and had a turnout of 31.4 per cent.
Stay up to date with the Waikato Herald
Get the latest Waikato headlines straight to your inbox Monday to Saturday. Register for free today - click here and choose Local News.