With her Girl on Fire album officially out, Alicia Keys took a break from her busy promotional schedule to honor superstorm Sandy first responders and volunteers in New York City on Tuesday.

The singer took to the iHeartRadio stage in lower Manhattan, singing several songs from her new album for the small group. Keys's son, 2-year-old Egypt, joined mom on stage for a bit, too, sitting comfortably in her arms as she belted her new tunes.

"Thank you again to all of the amazing first responders who continue to help with hurricane #Sandy," Keys wrote on Instagram after her show. "It was such a special night to perform for you all at the @iHeartRadio Theater!" – Melody Chiu

Mila Kunis braved a rainy New York City night to see Madonna live in concert at Yankee Stadium.

The actress – who sat front row – took her seat around 10:20 p.m., just moments before the "Material Girl" took the stage. Beau Ashton Kutcher was nowhere to be seen but Kunis spent her evening chatting with two male friends and happily posing for photos with fans.

"She wore a rain poncho just like the rest of the crowd," an onlooker tells PEOPLE.

After taking an unidentified brunette on a bowling date earlier in the week, Cruise, 17, a budding deejay, headed to Hyde Lounge at the Staples Center last week to catch the Enrique Iglesias and Jennifer Lopez show.

Cruise tried to remain incognito, sporting black pants, boots, a Louis Vuitton belt and red hoodie sweatshirt – with the hood pulled over his head much of the time. It didn't take long for him to cozy up to yet another brunette.

Jennie Garth made sure Monday night was relaxing for herself and for her three kids.

The actress and daughters Luca, Lola and Fiona came through 104.3 My FM's My Big Night Out 2 VIP lounge, at the Hollywood Bowl, where she was treated to a paraffin massage from a Burke Williams masseuse.

"Jennie told her kids to take photos with her," an onlooker tells PEOPLE. "She looked amazing and appeared to have shed some pounds. She seemed like she was in a great mood."

Following her pampering session, the newly single star rewarded her little ones for their patience by taking them to watch Kelly Clarkson in concert later that night.

The pop star performed a slew of hits, including, "My Life Would Suck Without You," "Since U Been Gone" and "Stronger," along with a cover of Fun.'s "We Are Young."

Just a couple of days earlier, the Bowl brought out Jerry O'Connell and Eric Stonestreet, who came to watch a performance of The Producers. The musical stars O'Connell's wife Rebecca Romijn, and Stonestreet's on-screen Modern Family beau, Jesse Tyler Ferguson.

"Jerry and Eric both looked beaming and happy," an onlooker tells PEOPLE. "Mel Brooks took the stage at the end." – Michael Fleeman and Dahvi Shira

Katy Perry is used to being the one on stage, but on Monday night, she was able to relax to the sounds of a live act other than her own.

The "Teenage Dream" singer took in a show by British indie pop band The xx, who hadn't performed in the U.S. in two-and-a-half years.

Perry, in a large bohemian-style black hat and a floor-length floral dress, hung toward the back of the Fonda Theatre in L.A., where the show was held.

"As her bra strap slid off of her left shoulder, a smiling Katy began to dance around to the band's hit, 'VCR,' " a source tells PEOPLE. "She was with a crew of pals, including her assistant and a few guy friends."

Fans of buzzed-about new R&B artist Frank Ocean were in for a special treat on Tuesday when they came to his show at the Wiltern in L.A.

Aside from being treated to his smooth sounds, the crowd also got a glimpse of Drake, who made a surprise appearance in the VIP section of the venue.

"He showed up in a white T-shirt and jeans, with a date on his arm," a concertgoer tells PEOPLE. "As the crowd noticed him walking in, they screeched and created a spotlight on him with their cell phones while taking his picture."

Once settled, the source says a head-bobbing Drake, "sang along to a majority of the tunes and seemed in great spirits while occasionally joking around with pals and taking pictures with fans."

The "Take Care" artist didn't show any overt PDA with his unidentifiable guest, but he "occasionally whispered in her ear," according to the insider.

Sara Bareilles and Keri Hilson were also guests at the show. – Jessica Herndon

While his band, Bush, was in Lansing, Mich., to perform at the Common Ground Music Festival, the singer dropped into Meat. Southern BBQ and Carnivore Cuisine.

The singer, who was in a ripped tank top, picked up a BBQ feast: a full rack of ribs and a sampling of sauces, blue cheese and bacon potato salad, plus some Texas red chili to go, telling staff it was for a fishing trip off on the Grand River. He shook everyone's hand and even posed for a picture with a staffer.

"He was really cool. We tried to give him free food and his tour manager insisted on paying us," Meat. owner Sean Johnson tells PEOPLE, adding that he gave them a very generous tip, as well as giving the staffers passes to see the show that night.

The singer enjoyed his food so much that he gave the eatery a shout-out later that night on stage! – Cara Lynn Shultz

Not singing along: West's girlfriend, Kim Kardashian, who didn't make it out to the first of three sold-out Watch the Throne tour stops in the City of Lights. Also missing: Jay-Z's other No. 1 fan, baby Blue Ivy Carter, nearly 5 months, who presumably stayed back at the hotel.

The youngest Obamas were animated and cheered during the show, and even sang along to "Love on Top," according to the report.

Before Saturday's show, Sasha and Malia were spotted splashing around the resort's pool. When the First Lady and her daughters arrived at the Revel Resorts cabana area – flanked by secret service officers – a white curtain was drawn to give them some privacy.