A number of the recordings featured on Joe's Corsage are demo versions of songs that would later appear on Freak Out!. The first set of demos, probably recorded in 1965, feature the guitar of Henry Vestine, who would later be a member of Canned Heat. Also included are covers of the Righteous Brothers' "My Babe", and Marvin Gaye's "Hitch Hike".