"For some reason, the shunt locomotive, pushing the wagon, has travelled across the marshalling yards to a linkspan – a ramp that connects the land to a ship – and fallen into the water," Moyle said after the incident.
Friday night's recovery operation was complex and required 10-hours of set-up work.
Marlborough Commercial Diving Services and Kenny Barging Picton, along with teams from KiwiRail and Port Marlborough, used airbags to float the locomotive and wagon before using large cranes to lift them out of the water.
The extraction was filmed by former politician Nick Smith.
"KiwiRail loco successfully fished out of Picton Harbour," he wrote in a social media posting, which featured a video of the operation.
"Credit to all to have recovery completed 55 hours after accident."
A "limited" amount of diesel leaked into the water but KiwiRail said it was "well contained" before it was skimmed from the harbour's surface.
The locomotive has been taken to a workshop for examination.
Moyle said the ongoing investigation is complex and is expected to take at least a month.
"The investigation will look at all issues, including the physical attributes of the yard, and it would be premature to comment on any specific issues until it is complete," he said.
"It is also too early to provide a cost for the recovery operation but it is expected to be considerable."
The link span at Cook Strait ferry Aratere's Picton berth, which was damaged in the incident, has been partially repaired and sailings have resumed.