Viewing figures for the ninth series of the talent contest are down 3 million on last year, and insiders have said that as well as pushing the 2013 series launch back a month, the team are considering bringing guest judge Mel B back to the panel as a permanent replacement for Scherzinger.

"It maybe airs a little early and people struggle when they might be on holiday or enjoying the sunshine at home," the source said.

"The guest judges just don't work. It's great for audiences who are watching live but it doesn't translate well on the telly.

"People get confused as the lineup's always changing from song to song."

In the meantime, producers are said to be hoping that the end of the Paralympics and the start of the Boot Camp and Judges' Houses rounds - including Cheryl Cole's return as Gary Barlow's guest mentor - will draw in bigger audiences.

Cole was clear to point out that her appearance, filmed earlier this month, took place as a favor to Barlow and wasn't a marketing ploy devised by Cowell.