Stephen Thomas Erlewine called it "a good dance tune", while BBC UK compared it to the "quintessential Janet" of "Whoops Now". "The Scotsman" said it "trumped" other songs on "Damita Jo", adding, "Already a sizeable download hit, it is likely to hang around the charts and our heads for a while." "The Hot Press" predicted the "rock-oriented" single to "hit the number one spot within days of its release." Spence D. of IGN called it "a most bizarre flip", praising Jackson for "unleashing an upbeat, rock infused number" of the "alternapop" genre. It was also commended for its "raking guitar chords that propel the song along." "The New York Times" qualified it as "a playful new-wave song". "Entertainment Weekly" exclaimed its "skittish, pared-down guitar opening" to be "fresh and surprising", evoking a vibe "sexier than her Matrix Super Bowl Revolutions outfit." Tom Moon described it to contain "that primal quality that gets people moving before they can even process the message." "The Ottawa Sun" wrote, "the album's most interesting, and energetic moment, is saved for the final track, Just a Little While, where there's some actual electric guitar near the front of the mix."