I actually kinda like the uncolored backgrounds. They pull focus to where it’s supposed to be. You might consider doing them on purpose here or there, for effect and to avoid too much busy crowding out the action.

Desaturation would be fine. And I think the “beige is not an interesting color to watch” is not an issue, but a possible design choice to, again, push attention away from what is not the focus right now.