Ashlee Simpson's 'Kinky' Gift for Pete Wentz

After Wentz and his bandmates played a show at Long Island’s Jones Beach, he and Simpson were spotted hanging out and smooching at his month-old rock ‘n’ roll bar, Angels & Kings, in Manhattan’s East Village.

The couple and their entourage, accompanied by a bodyguard, arrived at the bar at around 12:45 a.m. “The concert was a blast,” Wentz told PEOPLE. “It was really windy and it was hard to hear anything at all, but it was awesome.”

To celebrate his birthday, “I got a cupcake bashed in my face and then I jumped in the ocean,” he said. “The cupcake tasted awesome, but cupcake in your eyes doesn’t feel good.”

A more positive experience was Simpson’s gift, which appealed to Wentz’s inner geek: “Ashlee got me a Revenge of the Jedi poster. I’m kinky and it’s like, in Star Wars originally Return of the Jedi was called Revenge of the Jedi, and then George Lucas decided that [revenge] was not a Jedi-like trait,” he explained. “So she bought it for me. I think it’s sweet. It’s awesome.”

Wentz plans to continue celebrating with “a Vegas party for my birthday” in a week.

Next month, Fall Out Boy will travel to Uganda to film a video and help raise awareness of conditions there. (Click here to see a video of him talking to MTV about his efforts.) And he’s hoping Simpson will join him: “If I can convince her to get in a mosquito tent with me, just maybe Ashlee will come.”