University of Auckland lecturer and Pisa expert Fiona Ell said: "People get very hung up on the ranking ... because it's like a Top of the Pops top 10 thing. I don't think they should be ignored ... but knee-jerk reactions to rankings are really dangerous in education systems."
New Zealand students traditionally did better in reading than other areas, and the 2012 test comprised mostly of mathematics. The rise of East Asian countries whose learning was similar to the Pisa testing was also a significant contributor to New Zealand's fall.
Academics said that underlying the data that formed the league tables were some worrying statistics, in particular the rise in underachievers - the gap between those students who were doing well and those who were not had widened in the last three years.
This was despite the Government's determination to eliminate the tail of the education system.
Dr Ell said: "In some ways it's surprising in that there's been a lot of focus on priority learners and there's been a lot of work done in this space."
The drop has taken place under the National-led Government, but it said the results were part of a gradual, decade-long decline and blamed a range of factors which it inherited.
Education Minister Hekia Parata said these factors included a new curriculum which was still bedding in, high rates of exemptions in schools, poor data on student achievement and under-investment in teaching practice.
In an urgent debate in Parliament which was prompted by the Pisa results, Ms Parata reaffirmed her commitment to helping "five out of five students" - a reference to the belief that one in five students was failing in education.
Asked whether more money should be channelled into lower decile schools to lift up the low achievers, she said that a $110 million investment in poorer schools had not improved results. She said better targeting of investment was needed.
Not only had the achievement gap widened, but the number of people who were considered high achievers had also decreased in the Pisa study.
The Prime Minister's Science Adviser, Sir Peter Gluckman, said: "What's worrying is that there seems to have been a decline in the people represented in the top end of the scale and an increase in the number of people at the bottom end of the scale."
New Zealand was one of just two countries in which socio-economic status had a strong connection to a student's performance. Some countries' education systems made up for social disadvantage, but this was not the case in New Zealand.
While academics, MPs and unions said it was easy to identify causes of New Zealand's drop in ranking, they said it was more difficult to provide solutions.
Sir Peter said there was no quick fix to the problems with New Zealand's educational achievement, part of which was a cultural problem.
Educational achievement was set early in life, and it was hugely important to address primary teachers' low confidence in science and maths teaching.
Good teachers 'golden'
Celine Cromb may be one of the brightest sparks in her class, but even she knows what impact a good teacher can have.
The New Zealand Institute yesterday called for a lift in teacher quality in the wake of New Zealand's slide down the rankings in the latest Programme for International Student Assessment.
Celine, a Year 11 pupil at Tauranga's Otumoetai College, one of the biggest secondary schools, said a good teacher could often mean the difference between a student failing or being motivated to reach their potential.
"If a teacher doesn't teach you well, it doesn't help ..."
The 16-year-old, who this year studied maths at Year 12 level, considered she had "the knack of getting my head around things quite quickly".
But many students needed much support from teachers, at a time she believed secondary students were under more pressure than ever. "It's getting harder to get into universities and we are being pressured into achieving now, rather than leaving it to later on in your last year of school."
Celine also thought "being grouped with people who are at the same level as you really helps".
• Click here to read the full Pisa report.