Try pressing 2. This raises and lowers shelter walls in order to see around the place better. When the walls and roofs are up, pressing 2 once will take roofs down. Pressing 2 the second time takes walls down too. Either that or you have crafted the shelter but have not built it yet. Are there piles of wood and stones at the base of each wall section? If so, you must build the shelter.