Knowing where you are and what is around you is challenging for robots although great advancements have been made in recent years in areas such as drones, driverless cars and household robots. This talk discusses the challenges involved in navigating in an unstructured and changing environment and highlights the importance of extensive real-world testing especially as machine learning approaches become more prevalent.