Royal Dutch Shell PLC abandoned plans to build a multibillion-dollar plant in Louisiana that would convert natural gas into diesel and other fuels, amid skyrocketing costs for the project and doubts about where U.S. oil and gas prices are headed.

The latest cost estimate to build the Louisiana plant topped $20 billion, a huge jump from the $12.5 billion figure Shell released in September when it selected a site for the project south...