They claim that poorer countries are hit the hardest by tax dodging, losing out on US$170 billion ($249 billion) a year as a result.
The group, which includes 47 professors from British universities including Oxford and the London School of Economics, urged governments to "lift the veil of secrecy surrounding tax havens", and singled out the UK in particular.
"We need new global agreements on issues such as public country by country reporting, including for tax havens. Governments must also put their own houses in order by ensuring that all the territories, for which they are responsible, make publicly available information about the real 'beneficial' owners of company and trusts.
"The UK, as host for this summit and as a country that has sovereignty over around a third of the world's tax havens, is uniquely placed to take a lead."
Oxfam said that more than half of the companies set up by Mossack Fonseca, the law firm in the Panama Papers leak, were incorporated in British Overseas Territories such as the British Virgin Islands.
Jeffrey Sachs, director of Columbia University's Earth Institute and an adviser to UN Secretary General Ban Ki-moon, said: "Tax havens do not just happen. The British Virgin Islands did not become a tax and secrecy haven through its own efforts.
"These havens are the deliberate choice of major governments, especially the United Kingdom and the United States, in partnership with major financial, accounting, and legal institutions that move the money. The abuses are not only shocking, but staring us directly in the face."