"Holler" received generally favourable reviews from most music critics. Craig Seymour of "Entertainment Weekly" gave the track a B- rating, writing that the girls "sound like they really, really wanna be Destiny's Child", due to the song being produced by the same producer who produces Destiny's Child. Seymour also praised "its charms", praising the "easy yet funky groove, their exaggerated British accents (allowing them to rhyme "holler" with "follow"), and Jerkins' familiar slapping, kinetic beats". He also called it "their most compelling reason to dance since 'Say You'll Be There'." Stephen Thomas Erlewine of AllMusic simply picked the song as one of the best from "Forever". Dave Morales of KHKS wrote that, "when I heard the song I was surprised, this thing is a home run!". Erik Bradley of B96-Chicago called it "one of the pleasant surprises of the 4th quarter", pointing out that, "'Holler' will bring the Spice Girls BACK all the way!".