The move was foreshadowed by ASIO director-general David Irvine earlier this week amid fears Australians returning from the battlefields of Syria and Iraq could pose a danger.
The decision to raise the threat level was based on an accumulation of indicators, Mr Abbott said.
They include the number of Australians in the Middle East fighting with and supporting terrorist groups, those returning from there having fought with terrorist groups and the people in Australia who are known to be supporting these terrorists groups.
Mr Abbott said the increased threat level would not make a difference in the daily lives of the vast majority of Australians.
However, they will notice more security at airports, ports, military bases, government buildings and large public events.
"But I also want people to be reassured that we do have highly capable security and intelligence service ... highly capable police forces right around the country," he said.
State premiers and Opposition Leader Bill Shorten have been briefed about the increased threat level.
Acting Australian Federal Police commissioner Andrew Colvin said he wanted people to be more aware of the threat, but insisted they could also be reassured.
"While we're asking for increased vigilance from the community we certainly want to assure the community that there is no need to be unnecessarily concerned," he said.
"We want them to go about their normal business as they would on any other day."
The public should not expect to see significant changes in the ways police operate.
Mr Irvine, who is stepping down as ASIO head this week, reiterated there were between 60 and 70 Australians fighting for extremist groups like the Islamic State.
- AAP