So, this is a Unity limitation. It has a movement threshold in pixels. While it's fine for high dpi screens like modern mobiles, it becomes an issue on low dpi devices like a 32" display. I will modify mobile input to handle this case correctly.