The topic came up when the 49-year-old was asked about transgender Orange Is the New Black star Laverne Cox (who just became the first transgender person to be nominated for an Emmy), but Williams instead opted to address her own rumor mill.

"That is absolutely not [true]," she said of claims she's actually a male. The opinionated host went on to say she understands why some might think that, though.

"I get it. I've got a strong face, a strong body, I'm 5'11. I wear wigs. I get it," she said graciously with a smile. "Do I get upset with it? No."

But that doesn't mean Williams enjoys being called a man. "I get where that comes from, but in my opinion, there's no worse way to insult a woman than to say she looks like a man … [but] there's nothing you can call me at this particular point. I've been dealing with this for decades."

Something else the talk show host has been dealing with for years is abuse. As a child, Williams said her parents would "fat shame" her.

"I had a very tortured childhood," she claimed. "I didn't grow up the popular girl, or the popular cheerleader. I've never been to a prom, I didn't have a lot of boyfriends, so I'm used to being on this side of life."