You'd just have to look at every wall then. If you enter the Caves of Fire from the east, the shelf housing the idol is accessible (you'd have to go through lava). Similarly, from the idol in the Caves of Ice is accessible from the entrance, without any intervening doors or anything.