Tony Abbott has been sworn in as Australia’s new prime minister and promised immediate action to slow the stream of asylum seekers arriving by boats from Indonesia.

Abbott also pledged to repeal an unpopular carbon tax levied by the previous administration after being sworn in by Governor General Quentin Bryce at a ceremony at Government House in the capital Canberra.

He has been criticised for including only one woman in his 19-member Cabinet, Foreign Minister Julie Bishop – although she will be Australia’s first woman named to that post.

His conservative party defeated former prime minister Kevin Rudd’s center-left Labour Party in the September 7 elections.

“We are determined to honour our commitments to scrap the carbon tax, to stop the boats, to get the budget under control and to build the roads of the 21st century,” Mr Abbott told the ceremony.

“We aim to be a calm, measured, steady and purposeful government that says what it means and does what it says.”

Mr Abbott also announced that Australia’s controversial new policy on asylum seekers that includes turning back their boats to Indonesia would begin immediately after the swearing in ceremony.

Australia has seen an increase in the number of such asylum seekers from Iran, Afghanistan, Pakistan, Vietnam and other countries, many of whom pay smugglers up to £6,300 to get them to Australia from Indonesian ports

The incoming government announced yesterday that deputy army chief, Major General Angus Campbell, had been appointed to lead Australia’s new border protection policy, Operation Sovereign Borders. He will be promoted to lieutenant general in this new role.

Tony Abbott shakes hands with Governor General Quentin Bryce after being sworn in as the 28th prime minister of Australia

The new policy, which has been criticised by Indonesian officials, also includes buying fishing boats from Indonesian villages to prevent them falling into the hands of people smugglers.

Australian officials will also pay villages for information about people smugglers under another controversial aspect to the policy.

Acting opposition leader Chris Bowen said today that the plan would cause problems for the countries’ close relationship.

“Mr Abbott has told us he wants a Jakarta-based foreign policy at the same time as saying to Jakarta we don’t care what you think, this is what we’re doing,” he said.

Mr Abbott plans to make his first international trip as prime minister to Indonesia on September 30 to discuss the plan and other issues.

On energy policy, he plans to order officials to draft legislation that would repeal the carbon tax imposed on the country’s biggest greenhouse gas emitters.

The tax has been attacked over its impact on household power bills since it was first levied from July 2012.

Mr Abbott will remove the tax from July 2014 if the Parliament passes his legislative agenda.

From Wednesday, the Clean Energy Finance Corporation, a 10 billion Australian dollar (£6 billion) government fund to finance low-pollution technologies, will be barred from making any further loans.

Australia is one of the world’s worst emitters of greenhouse gases on a per capita basis due largely to its heavy reliance on abundant reserves of cheap coal for electricity generation.