A broad new government rule to limit risk-taking by Wall Street will force banks to rethink virtually every aspect of their trading activities, setting the stage for more tumult at the largest U.S. financial institutions.

The so-called Volcker rule, approved by five financial regulatory agencies on Tuesday, could lop as much as $10 billion total in yearly pretax profit from the eight largest U.S. banks through lower revenue and...