Hey Rob, you’re absolutely right.
If you use Bitcoin Core (i.e. a full node) you will need to download the whole Blockchain to your device. Mobile phones use SPV wallets that don’t download all of the blockchain but only a critical portion of it and rely on full nodes to verify transaction. More information can be found on our latest Bitcoin whiteboard Tuesday episode.