In the April issue of Vanity Fair, 23-year-old Swift recited a quote Katie Couric once shared with her when asked how she deals with "mean girls" in Hollywood: "There's a special place in hell for women who don't help other women."

Handler, who is friends with Couric, addressed the controversy when AndyCohen asked her to weigh in. "I think that was a bold statement, but I'm not on anyone's side because I just don't care enough," the 38-year-old Chelsea Lately host said. "I like that she's being that vociferous about something that she thinks they were out to get her. They were clearly making a joke just about her demeanor, which is embarrassing. I mean, she's just dated so many men."

"My theory about Taylor Swift is that she's a virgin, that everyone breaks up with her because they date her for two weeks and she's like, 'I'm not gonna do it.' And they're like, 'Oh, well, forget it. Then I don't want to date you,'" Handler imagined. "Every guy thinks they're going to devirginize her, and they're not. She's never going to get devirginized, ever, ever, ever, ever."

In her Vanity Fair cover story, Swift -- who has never publicly commented on her purported sex life -- said she has dated "exactly two people" since 2010. Though she's known for penning breakup anthems about her exes, the Pennsylvania native doesn't think her love life is anyone's business.

She explained, "For a female to write about her feelings, and then be portrayed as some clingy, insane, desperate girlfriend in need of making you marry her and have kids with her, I think that's taking something that potentially should be celebrated -- a woman writing about her feelings in a confessional way --that's taking it and turning it and twisting it into something that is frankly a little sexist."