But there have been positive signs.
The Council of Trade Unions urged its members to unite behind Rudd to ensure that Abbott does not win power, and a snap Morgan poll made after the vote showed a sharp leap for Labor.
The poll said that in the two-party preferred vote that determines Australian elections Labor now trailed the Coalition by just one point and concluded that if an election was held now the result would be too close to call.
Just when the election will be held is now in doubt.
Gillard had set the date as September 14, but there is conflicting speculation that Rudd may go early to capitalise on a return-to-power honeymoon and to blunt Abbott's counterattack, or, alternatively, that he may delay until later in the year.
Pressed by Abbott in Parliament yesterday, Rudd sidestepped the issue and said only that it would conform with constitutional requirements, which sets a deadline for this election of November 30.
Rudd is also unlikely to face a test of his ability to govern, with Abbott saying he was not likely to seek a vote of no-confidence because it was the people's responsibility to choose their government.
"All we've had for the last three years are back-room deals and back stabbing orchestrated by the faceless men who are not interested in the welfare of the Australian people," he said.
Rudd would also probably command a majority. While the votes of retiring independent New South Wales independents Tony Windsor and Rob Oakeshott are uncertain, he would be supported in a confidence vote by north Queensland MP Bob Katter, the Greens' Adam Bandt, Tasmanian independent Andrew Wilkie, former Labor MP Craig Thomson and disgraced former Speaker Peter Slipper.
Rudd has also started adding heavyweights to his frontbench: Leader of the House Anthony Albanese is the new Deputy Prime Minister, former Immigration Minister Chris Bowen is Treasurer, turncoat Gillard supporters Penny Wong and Shorten remain in finance and workplace relations, and Gillard loyalist Gary Gray has agreed to remain as Resources Minister.
However, others have quit: Defence Minister Stephen Smith, Trade Minister Craig Emerson and Schools Education Minister Peter Garrett will leave politics. Treasurer Wayne Swan, Climate Change Minister Greg Combet, Communications Minister Stephen Conroy and Agriculture Minister Joe Ludwig have moved to the backbenches.
Whatever the team, Rudd will need to show he is a changed man, as he says he is. His autocratic, micromanaging style and bad temper alienated colleagues he will have to unify.
Speaking in Parliament after being sworn in, Rudd appealed for an end to the negativity that had eroded trust in politics, and for a new approach to the "very hard life" of politicians.
Yesterday's question time showed there is little chance of that. The Opposition is planning a campaign that will focus on the abuse heaped on the resurrected Prime Minister by Labor colleagues during leadership spats.
The Coalition is already airing a cartoon depicting Rudd and colleagues as headless chooks, with an entire arsenal in reserve, including Labor MPs' public descriptions of Rudd as "a psychopath", a "giant ego", "dysfunctional" - and more.
Rudd will also have to discredit Abbott's continued attacks on Labor as a profligate, incompetent Government whose stability remained in doubt and whose policies were unchanged.