WASHINGTON—President Donald Trump is expected to nominate John J. Sullivan to be the State Department’s No. 2 official, according to U.S. officials familiar with the discussions.

Mr. Sullivan, 57, initially was the Trump administration’s pick to be the Pentagon’s general counsel, news the White House announced earlier this month. But in recent days Trump administration officials decided they would instead tap him to be deputy...