I've got a custom RCP application here and am looking for a way to remove
the toolbar and menu's contributed by the org.eclipse.debug plugin without
changing the plugins configuration?

I've found an older thread in which its suggested to use activities, but
that only seemed to work when loading the jdt plugin (IIRC). Also that
thread is from 2005 and I hope things improved by now in that area?