Military spokesmen and protesters said about 40 people attacked the masonic lodge and the police station before a larger crowd invaded the town's tuna cannery and took the general manager hostage.
The military said the violence would be easily contained with the co-operation of Speight and his men.
"With the information we have ... and the work that Speight and his group are doing, we believe the situation will remain under control," military spokesman Lieutenant-Colonel Filipo Tarakinikini said.
Rumours swirled through the capital, Suva, yesterday. Police denied reports the main police station was to be evacuated because of a planned march by nationalists. The police station remained open and there was no sign of marchers gathering.
The military had earlier said the masonic lodge was attacked because the villagers saw it as an anti-Christian symbol and a reminder of the British colonial era. About 40 people tried to attack the nearby police station but retreated after police fired warning shots. There were no injuries.
Levuka, a former whaling settlement dating back to the 1830s, is on the island of Ovalau, about 70km northeast of Suva.
At the Pacific Fishing Company cannery, a man who gave his name as Bill said that about 200 Speight supporters had occupied the plant. They were holding general manager Miti Baleivanualala hostage but would not harm him.
"We will stay here until Thursday," he said, referring to the date set by rebels for the release of Chaudhry and the other political hostages held by Speight at the Parliament in Suva.
Speight's rebellion has halted much of the economic activity on which Fiji depends. Tourists have stayed away and much of the sugar cane crop has been left rotting in the fields.
Speight supporters have occupied an electricity supply station, a military base and two police stations, holding hostages in some cases.
The agreement grants Speight and his gunmen amnesty, effectively overturns the civilian Administration appointed by the military, and empowers the influential tribal elders' group, the Great Council of Chiefs, to choose a president and vice-president and to have a say in naming a civilian government.
Speight said he was confident the chiefs would name Ratu Josefa Iloilo, the rebels' candidate, as president. Iloilo was described by New Zealand Foreign Minister Phil Goff yesterday as an elderly man who might be prone to influence and control.
"It's an outstanding success for George Speight and a spectacular failure for the military," said historian Brij Lal, who helped draft Fiji's abandoned multiethnic constitution.
Meanwhile, it has emerged that Speight was recruited at the eleventh hour by the nationalist plotters who stormed the Parliament in May.
It was only hours before the attack that Speight met coup strongman and behind-the-scenes military commander Major Ilisoni Ligairi, Speight told ABC's Four Corners programme.
"I didn't know Speight until 30, 40 minutes before the coup," added Ligairi, a former member of Britain's elite Special Air Service and a staunch nationalist.
While Speight is the public face of the Fiji coup, Ligairi has emerged as a powerful backroom figure among the coup plotters. Ligairi is head of the Fiji military's counter warfare unit, which provided many of the seven armed men which stormed Parliament.
Speight said the plotters had expected the rest of the military to join the coup.
- REUTERS
More Fiji coup coverage
Main players in the Fiji coup
The hostages
Under seige: map of the Parliament complex
Fiji facts and figures
Images of the coup - a daily record
Fiji’s new PM addresses the nation
George Speight: "I’m certainly not mad."