On a standout day for the Premier League's underdogs, Manchester City, Arsenal, Chelsea and Tottenham all dropped points.
Manchester City were held 2-2 by Crystal Palace, further boosting Liverpool's title hopes, after Tottenham drew 0-0 at Watford.
Arsenal's underwhelming form under new manager Mikel Arteta continued in a 1-1 draw with Sheffield United, while Chelsea looked headed for a draw until Isaac Hayden headed in to give Newcastle a 1-0 win in stoppage time.
Not even Sergio Aguero's fearsome scoring form could earn City a win over a tenacious Crystal Palace team.
With City staring at a possible defeat courtesy of Cenk Tosun's 39th-minute goal for Palace, Aguero scored twice in the last 10 minutes, taking him to six goals from his last three league games. However, Palace levelled in the 90th when Wilfried Zaha's ball went in off Fernandinho.