1998 was the next time England faced off in a penalty shootout – against old rivals Argentina. Hernan Crespo missed the second penalty for Argentina, giving England hope, before Paul Ince missed the next shot. David Batty then missed England's fifth attempt, giving Argentina a 4-3 shootout victory.
England's third penalty shootout defeat was their worst effort. Frank Lampard, Steven Gerard and Jamie Carragher all missed from the spot against Portugal in the 2006 quarter-finals. Portugal missed two attempts as well before Ronaldo secured the winner by converting his side's final attempt.
In this morning's game, it all looked over for England once again when Liverpool's Jordan Henderson's shot was saved, the team's third attempt. However Colombian Mateus Uribe had his attempt saved by Jordan Pickford before Eric Dier scored England's fourth. With a must-make shot on the line, Carlos Bacca's shot was saved by Pickford.
History was made. Next up for England, Sweden...who have a 100 percent World Cup record in shootouts.
Here's a look at how the penalty kicks unfolded at the Spartak Stadium in Moscow:
COLOMBIA 1-0
Colombia captain Radamel Falcao won the coin toss, choose to shoot first, and took his team's first spot-kick high and straight. England goalkeeper Jordan Pickford dived to his right side.
ENGLAND 1-1
England captain Harry Kane had already scored a penalty, high and straight, in the second half to give his team the lead. This time he fired it low and hard into the bottom corner, just beyond the fingers of David Ospina diving to his right side.
COLOMBIA 2-1
Juan Cuadrado hit a rising shot to the left top corner side, high away from Pickford's dive to his right.
ENGLAND 2-2
Substitute Marcus Rashford copied Kane, hitting the ball low and hard into the corner as Ospina again guessed correctly to his right but could not reach it.
COLOMBIA 3-2
Luis Muriel coolly hit a slow kick to the right side of the goal, wrong-footing Pickford who dived to his own right side.
ENGLAND 3-2
The first failure due to a fantastic Ospina save. Jordan Henderson side-footed his spot-kick low toward the bottom right corner but Ospina stretched to his left and used a strong hand to push the ball away.
COLOMBIA 3-2
A miss by Mateus Uribe, striking the ball with his right foot high to the goalkeeper's left but rising too fast. The ball struck the underside of the crossbar and bounced out to safety with Pickford having dived the correct way.
ENGLAND 3-3
Defender Kieran Trippier struck a rising spot-kick into the left corner of the net, just out of reach of Ospina's dive. The Colombia goalie again chose the correct side.
COLOMBIA 3-3
The key save by Pickford. Carlos Bacca hit a rising ball to Pickford's right, but the England 'keeper had skipped forward off his line to narrow the angle. Pickford had strong forward momentum and beat the ball away with his left hand thrust high.
ENGLAND 3-4
For the third time a Tottenham player stepped up to face the Colombia goalkeeper who plays for north London rival Arsenal. Eric Dier placed his shot low toward the left corner, and Ospina again guessed correctly, but the outstretched fingers of his right hand could not keep the ball out.
At the fourth attempt, England defied memories of exits on penalties in 1990, 1998 and 2006, finally recording its first World Cup shootout win.