Only 27 percent of people surveyed in a new poll think Democrats should keep Rep. Nancy Pelosi (D-Calif.) as their leader in the House, with nearly half of Democrats surveyed saying the caucus should pick a new chief.