Southgate's side looked to have emerged unscathed from an ill-disciplined match courtesy of Harry Kane's penalty, only for Colombia's Yerry Mina to equalise in the closing seconds of stoppage time to send the massed ranks of Colombia fans wild.

The extra 30 minutes could not separate the sides and led to a nerve-shredding finale that has so often been England's undoing, with a dismal record of just one win in seven shootouts at major tournaments before this.

England looked to be set for more agony when Jordan Henderson's penalty was saved by David Ospina but Mateus Uribe smashed the following kick on to the crossbar to pave the way for Pickford and Dier to be England's saviours.

No previous world champions stand between England and the final. The winners of their quarter-final will face either Croatia or hosts Russia for a place in the Moscow showpiece on 15 July.

England have won two and lost six penalty shootouts in major tournaments

England survive test of nerve

England's survived a test of nerve that will prove invaluable as they drive deeper into this World Cup after a night of noise, colour and hostility in Moscow.

Southgate's side cast off the clouds of dread that have come over England in penalty shootouts in the past, a psychological lift that may yet help them further down the line.

Colombia made their intentions clear from the off. This was going to be a scrap and Jose Pekerman's side would be the beneficiaries if England were dragged into it.

England lived on the edge in those physical exchanges but the manner in which they survived and came through that test will add an extra layer to the satisfaction.

Media playback is not supported on this device

Pickford saves, Dier scores - England win penalty shootout

And within the dogged team performance, individuals once more made their mark.

Everton goalkeeper Pickford received some criticism for his performance against Belgium but was outstanding here, not only saving that Bacca penalty but producing one of the saves of the World Cup from Uribe's thunderous drive from 30 yards - which cruelly led to the corner that brought Mina's equaliser.

And Trippier's measured penalty was another indication of his growing maturity at this level, the Spurs full-back having again performed solidly down England's right.

England edge towards glory

Southgate's one-match-at-a-time mantra has been designed to keep expectations in check as his side have been presented with their best opportunity at a World Cup since they reached the semi-finals of Italia 90.

If he was listening to the England fans who gathered and sang non-stop late into the Moscow night behind the goal in the Spartak Stadium, it may have dawned on him that keeping a lid on expectations is likely to be a losing battle.

England will have taken a lot out of themselves in this physically gruelling and mentally taxing last-16 game and they now face the well-organised and resilient Swedes.

If they can overcome Sweden, the possibility of a semi-final meeting with Russia or Croatia comes into view.

England found a way to win here that has often eluded them, digging deep in the process - and they will have headed back to their Zelenogorsk training HQ in soaring spirits.

There is work to do, though, and this was not a flawless performance by any means, but England and Southgate have now regained the momentum they lost in their group-stage loss to Belgium and can look to build on that.

Media playback is not supported on this device

World Cup 2018: England's historic penalty shootout win against Colombia in full

Referee Geiger lost the plot

American referee Mike Geiger's failure to clamp down on early misdemeanours led to him losing control of a game that Colombia seemed determined to turn into a battle.

Instead of imposing his authority on proceedings with firm decision-making, he instead indulged in lengthy discussion with players from both sides on numerous occasions.

It lead to Colombia, in particular, pushing him to the edge - although England were not total innocents, with both Henderson and Harry Maguire leaving themselves open to accusations of being over-theatrical and many others sailing close to the wind.

This would have been a tough night for any referee, with players clearly failing to respect his decisions, and making no attempt to make the official's life easier, but it is to be hoped officials with a greater sense of authority are handed the huge games that remain here in Russia.

Media playback is not supported on this device

Southgate and England players react to shootout win

Man of the match - Harry Kane

England's leader. Showed great nerve for his penalties and takes on all the responsibility with supreme character

Match stats - Kane sets best England run since 1939

England have won a penalty shootout at a major tournament for only the second time, also beating Spain in Euro 96.

England have qualified for the quarter-final of a World Cup for the first time since 2006.

Colombia have lost three of their four knockout matches at the World Cup (also the last 16 in 1990 and the quarter-final in 2014).

The team going first in a penalty shootout have now lost all three at the 2018 World Cup.

Harry Kane became the first player to score in six consecutive England appearances since Tommy Lawton did so in 1939.

Kane has scored six goals in his first three World Cup appearances for England - only three players have scored more in their first three matches; Hungary's Sandor Kocsis (nine), Germany's Gerd Muller (seven) and Argentina's Guillermo Stabile (seven).

The last England player to be fouled more often in a World Cup match than Kane in this match (nine) was Alan Shearer in 1998 against Tunisia (11).

Kane has scored 14 goals in 10 England appearances under Gareth Southgate, scoring in all eight matches he has played as captain (12 goals).

Mina has scored in all three of his appearances at the World Cup, with all three headers.

Kane has scored six goals from six shots on target at the 2018 World Cup.

England conceded in injury time at the end of the second half for the first time in World Cup history, with Mina's goal coming after 92 minutes and 33 seconds.

Eight of England's last 15 World Cup knockout matches have gone to extra time, with the first match in this run the 1966 World Cup final.