You can imagine a speaker box as room, as with a room the box will suffer from similar issues, standing waves, resonanant peaks, reflections. Now where will those reflections bouncing around the box go? They will end up radiating back out through the cone and you can imagine the rest.