5 April 2016 Last updated at 12:25 BST
She's the latest change to the line-up after Nick Grimshaw said he was leaving in February, after just one season on the show.
Presenters Olly Murs and Caroline Flack will also be replaced by Dermot O'Leary who is returning after a year away.
Cheryl said: "I've missed making music. I have had such an amazing experience being a judge on The X Factor."
Cheryl Fernandez-Versini will not be part of the X Factor judging panel when it returns later this year.