"We can't be conceding those goals so early in games. In finals football you're not going to come back like that," Durante said.
"We are shooting ourselves in the foot early on. We speak about it every week and it's crept in to our game over last month. So, lots to work on."
Wellington meet Sydney FC in the capital next Sunday in their final outing of the regular season before the playoffs begin.
Depending on how results fall in the final two rounds, they could finish anywhere between first and fourth given the close nature of the standings.
A top-two finish is desirable for the Phoenix as it will give them a sweeter trip in the playoffs.
Phoenix coach Ernie Merrick was pleased with his side's ability to fight back last night after he spoke to them at halftime about how there weren't enough players getting in to goal-scoring positions.
Merrick made a double change in the 60th minute, which included shuffling his midfield and defence but the key insertion was that of Cunningham.
"Every time he's come on he's made a real impact and credit to him, he was fantastic," Durante said.
Cunningham has made only 15 appearances this season, 14 of which have come from the bench, but last night's effort was his most valuable contribution of the campaign.
The Mariners put up a resounding fight considering they had so little to play for given they're out of finals contention.
But coach Tony Walmsley said there were no issues around motivation for his side and last night's result was a cruel way to lose given the winning goal came so late.
"It's one where you feel for the players because they're obviously devastated," Walmsley said.
Wellington Phoenix 3 (Roly Bonevacia 65, Kenny Cunningham 79, 90+5) Central Coast Mariners 2 (Nick Fitzgerald 11, Eddy Bosnar 35) halftime: 0-2
