"They will provide training for our military in New Zealand, and the role will change," he said.
"The have been reducing (troop numbers) from the beginning, and after the elections they will be gone."
Dr Mapp said the agreement would provide a solid foundation for the relationship with Timor-Leste once it took responsibility for its own security matters.
Mr Gusmao said he had also spoken to Prime Minister John Key earlier in the week, and had asked if New Zealand could provide more support for Timor-Leste's customs and education programmes.
"The New Zealand help has been very good so we've asked for further support," he said.
"We are still in need of more technical assistance about how to do the job."
Mr Gusmao said Mr Key had seemed positive about the idea and had said he would consider it.
Mr Gusmao has been in New Zealand since Tuesday observing the Pacific Islands Forum.
Timor-Leste has applied to be a member of Asean, which does not allow dual membership with the forum, but Mr Gusmao said it was important for Timor-Leste to keep up its relationships in the Pacific region.
"We are Islanders, we have many, many common issues and we have to work together," he said.
Among the regional issues Mr Gustao said he was particularly interested in was the problem of illegal fishing, communication concerns and promoting economic growth.
The Prime Minister is in town until tomorrow morning, just long enough to catch the opening Rugby World Cup match between Tonga and the All Blacks.
He might not be popular with local fans - today pledging his support for "underdogs" Tonga.