Watch Kesha's Powerful Bob Dylan Cover With Ben Folds

Kesha joined Ben Folds onstage Wednesday night at the Orpheum in Los Angeles to perform the song she was meant to sing at the Billboard Music Awards on Sunday: a cover of Bob Dylan’s searing classic “It Ain’t Me Babe.”

Earlier that day, Kesha’s Billboard performance was axed following rumors that she was going to reference her highly publicized legal battle with producer Dr. Luke onstage. Kesha, who has steadily returned to music after months of silence, explained via Instagram that she was meant sing the Dylan cover at the awards show.

During Folds’ concert with yMusic, fans got a glimpse at the performance that might have been. Kesha belted a tender, orchestral rendition of Dylan’s sour heartbreak anthem, with Folds accompanying on piano. Later, Kesha joined Folds’ on “Still Fighting It” and requisite crowd-pleaser “Rock This Bitch,” which naturally segued into Kesha’s “Sleazy.”

“Thanks for believing in me,” Kesha wrote in an Instagram post accompanying a picture of Folds cleaning a wine glass with his “old man panties.” “Thanks for ur records that got me through high school. Thanks for being a genius composer. Thanks for being nice when we work together. Thanks for letting me play a Bob Dylan cover with you. Thanks for being a good friend in this scary business.”