The full lyric is "Flew me to places I'd never been/'Til you put me down," so naturally people are trying to connect the dots and say that they flew to a romantic vacation and Harry somehow put Taylor down.