His affair with future baby mama Lauren Silverman is getting the X Factor judge all sorts of unwanted publicity, and now the man he betrayed is calling the mother of his unborn child some pretty nasty words!

Estranged spouse Andrew Silverman filed divorce papers against Silverman two weeks ago that apparently described her as "cruel and inhuman".

The two spoke out earlier, addressing the situation with THESE comments, but as for Simon Cowell and Lauren Silverman's future? Well, apparently Lauren wants her future baby daddy to help turn her into a reality star!

But Simon reportedly is not down with that!

Here's how a source explained it:

"Lauren has also started to push Simon to turn her into a reality TV star. She wants her own show like the Kardashians and has already apparently started filming the pregnancy. Simon is horrified and has said no. He [Cowell] is already talking about creating separate baby wings in all his homes for Lauren and the baby. His mansions are huge and he will effectively be allowed to carry on with his own life without disruption. He has no problems looking after his heir apparent – that is all he is interested in and he will ensure Lauren has a roof over her head in order to raise his child."

As for whether marriage is in this "couple's" future - don't count on it!

Here's what a source said:

"Simon does NOT, NOT, NOT plan to get married to her [Lauren]. Simon is gearing up for a potentially ugly child support battle. He tried desperately to reach an agreement with Lauren before it went public but she surprised Simon and leaked the news. Simon was hoping to reach a financial agreement with her and then release a joint statement but Lauren is savvy and wants to be famous and when he refused her opening demands for marriage she leaked it."

We could definitely see why Simon would've wanted to squash this scandal before it was leaked. Unfortunately that obviously was not the case and now he'll have to deal with the fallout!

Good luck, Simon!

And try and look on the bright side - you're going to have a baby pretty soon!

considering she was smiling for the cameras the day after while walking her with her son kind of showed to me that she was looking to become famous. I mean, you're with your kid and this "scandal" is in play, have some humility while around your child.