Lightroom 4: Esc to gridview after delete doesn't work

When in the grid view, select a picture and hit Enter to view in loupe view. Then, hit the Del button (on the keyboard) and select to delete the picture from disk. Then try pressing Esc to go back to grid view. Doesn't work.

Normally, when not deleting the picture, Esc bring you back to grid view.