Simon Cowell: The real reason Britney Spears isn't on X-Factor