I can think of an excellent reason to take the Sixth Doctor to the desert island. His clothes are visible from space, so they would greatly increase the chances of being spotted by passing craft, and rescued! 🙂