This isn't really a "fixable" problem. You are not always going to have an opponent to fight when there is only a max of 20 people in the room. What makes DM special is the small room size. How do you imagine this being "fixed"?