But looking at the bright side, I don't think we would have gotten spin-off films if he stayed with the X-Men, instead there would have been a X4/X5 films after X3 and even though I would have preferred it that way, Singer would have been burnt out directing X-Men films and it would reflect in the quality of the movies and it would lead to the "Sam Raimi situation" that happened to Spider-Man 3/4.

Yeah I guess that's possible but we'll never know. Tbh Singer needs a hit now and something that's good. If he hits DOFP out the park then he's a hero to the X fans and his reputation is restored cause he's been on the decline post X2.