A fortnight ago England were the third ranked team in the world but Eddie Jones' side now sit sixth following Sunday's second test defeat to South Africa.
The loss was the side's fifth in a row and saw Wales and South Africa both move past England in the World Rugby rankings.
The All Blacks remain in top spot, a position they have held since 2009.
Ireland hold second place following a victory over Australia on Saturday. The defeat saw the Wallabies drop to fourth with Wales now the third ranked side in the world.
South Africa jumped up from seventh to fifth, while Scotland dropped one spot to seventh after a shock loss to USA.