Before the performance begins, Antony tells the very happy and funny back story to the song: "We recorded it in a 10-dollar studio", he says. "We canned it for like two years because we were like, 'This sucks.'" Watch footage of the song below, via Stereogum.