You navigate the places, looking for someone:Go to town > Outside Town > Witch's ShackYou realise that the girl you are looking for is not here: you leave for the next place.The place menu is back to the beginning. If you want to go to the next place, you have to remind what the district was ("Outside Town") and select it again.

It would be easier when you are looking for a girl and more logical to stay in the district "Outside Town".