Reviewing the parent album for "Rolling Stone", Barry Walters also compared it to Madonna's earlier work. Sal Cinquemani from "Slant Magazine" called it Madonna's best dance track since "Vogue", also comparing it to her 1985 single, "Into the Groove". In his review of Madonna's 2001 compilation "GHV2", Cinquemani praised the single's "retro club beats and vintage synth sound". Giving it a B rating, he concluded that "only a former material girl living in a NASDAQ world could get away with a song like this". Dimitri Ehrlich from "Vibe" found "Music" to be "a bouncing parade of synthesizers that pose the question 'Do fortysomething baby-mamas still have the divine right to get down?' (The answer is yes)". Chuck Arnold from "Entertainment Weekly", called it one of Madonna's "most eccentric hits ever" and found it to be reminiscent of her earlier works, specifically "Holiday".