Below is a who's who of some of the women who have been in Simon's life - at least the ones that we know about...

Paula Hamilton (Cowell years from 1977)

PA

Paula lost her virginity to Simon when they were teenagers

One of the most famous models of the 1980s, Paula revealed last year how she lost her virginity to Cowell when she was 16 years old. She and "a boy called Simon" (it's definitely him - she's sure) were childhood sweethearts while growing up in Hertfordshire and had known each other from the age of 12.

She said, "He was very, very protective of me...I couldn't read or write until I was 11 so was called stupid and bullied by teachers.

Simon was really important to me because he stopped them picking on me." What a gent.

Louise Payne (Cowell years 1995 - 1998)

PA

This might not have been the best dress to turn up in for your dinner date, Louise

The Daily Star have reported that Simon Cowell was secretly engaged to Page 3 model Louise Payne during their on-off three year relationship.

He apparently approached her after spotting her at a swanky London shindig and was completely smitten for yonks.

Reportedly it all ended when she told him she wanted kids and he wasn't ready.

Sinitta (Cowell year 1984)

Getty

Sinitta - still Simon's right hand gal

Probably Simon's most famous ex, Sinitta dumped him when she embarked on an affair with David Essex.

They're still mates though (standard) and she's even wrangled herself some regular guest-mentoring gigs on X Factor.

Georgina Law (Cowell years pre-2002)

Tim Anderson

Simon and Georgina Law. She can't sing, but she can...Oh, behave

Page 3 girl and lap dancer Georgina sold a kiss and tell story about her relationship with Simon with Simon's blessing.

She said, "I met Simon at the Spearmint Rhino Club where I used to work occasionally. This was before Pop Idol so he wasn't famous. He is a lovely man and we had a casual relationship for about six months. We weren't proper boyfriend or girlfriend, but we'd see each other regularly."

Simon later told The Sun, "She's a great girl. We find an awful lot to laugh about, but she'll never be a Pop Idol. If you've heard her sing in the shower you'll know what I mean. But she has tremendous talents in other areas." Eugh.

Jackie St Clair (Cowell years in the 1970s)

Getty

Simon and Jackie - still bezzie mates

One of a trio of Simon's exes that have remained friends with the media mogul. He's been known to take the ex-page 3 model on holiday with him and whoever his latest girlfriend is at the time.

His longest ever relationship was with telly presenter Terri Seymour - they were shacked up together for a whopping seven years before she dumped him.

They've remained friends though and she too has been seen gallivanting about with him on some of his numerous holidays.

She said in an interview in 2010, "We do still speak every day. Actually we'll often speak to each other five, even 10 times a day. And when Simon is in LA we see each other daily."

Getty

Terri decided she wanted to Seymour blokes so ditched Simon

Dannii Minogue (Cowell year 2007)

PA

Simon and Dannii? SCANDALOUS

The revelation that Simon was sleeping with Dannii while she was an X Factor judge was revealed in Tom Bower's unauthorised biography of Cowell called 'Sweet Revenge: The Intimate Life of Simon Cowell'.

In it Simon says, "It was Dannii's hair, the sexy clothes, and the t**s. I was like a schoolboy. She was foxy. She was a real man's girl. Very feminine. It was genuine love."

Apparently they were only 'together' (ooo er) a few times and remained friends.

Mezhgan Hussainy (Cowell years 2009 - 2011)

Now this is a weird one. Simon proposed to the make-up artist in 2010 after they'd been dating for a several months, but then it all went quiet.

And then even more quiet. And then silent. Now it turns out Simon bought her a $5million house as a parting gift. Nice.