"It hurts us when we see headline like 'Simon Cowell wanted Brian'. We did nine-and-a-half years without him and sometimes the press and stories can affect the relationship because there is no ill feeling from either end.