"Late Registration"s longest track, the seven-minute-long "We Major", implements exuberant, amplified backing vocals and a "splashy disco groove" featuring a bassline, electric piano Glissandos and horns. The melody of "Hey Mama" is laced with a folksy looped "La-la-la" vocal sample from "Today Won't Come Again" by Donal Leace, while its beat is produced by Tin Pan Alley-styled Drums. Additionally, it contains vocoder-processed background vocals, a xylophone solo and a cascading synth outro. "Celebration", opening with an electronic twinkling sound, contains samples of "Heavenly Dream" by The KayGees. A columnist for "The Guardian" described it as evoking "the lavish 1970s psychedelic soul of Rotary Connection."