The Preferences popup only lists which KINDS of shortcuts appear in the Finder sidebar. So close that and forget it for now.

Did you try right clicking and choosing "Remove from Sidebar"? And when you try dragging things out, are you dragging them as if you were trying to put them on the desktop, or are you dragging them somewhere else?