VB stops registering keypresses with Fedora 11 guests

Description

When using Fedora 11 based systems (without guest additions installed), I frequently find my keyboard no longer working to input text for the Guest OS. Because the mouse is captured, the only things I can do at this point is to try to shutdown the guest using
the mouse. If I then, shutdown VB as well, I find that I can't type text into any of my native OS apps as well. I also have problems getting most mouse input to work as well. I usually end up using
CTRL-ALT-BACKSPACE to shutdown my host OS's X server. This frees up
my keyboard and mouse and I can log in again. I never see this problem when using a Windows XP guest. I've been installing/testing various F11 and derived systems alot recently and this happens to me all the time.