The melody and one repeated lyrical verse of the song first appeared as part of "Hey Hey We Are Not The Monkees" from The JAMs' debut album, "1987: What The Fuck Is Going On?". All of the album's most prominent characteristics are notably absent in this part of "Hey Hey...", which has female vocals (as opposed to the rapping of The JAMs' Scottish co-founder Bill Drummond), inoffensive lyrics, and it is free from plagiarised samples of other artists' recordings. Also in contrast, "Hey Hey" itself begins with a minute's worth of typical human sexual intercourse noises, arranged as a rhythm. It progresses into a cryptic and bleak spoken verse from Drummond and descends into a cacophony of samples from "The Monkees Theme". An abrupt cut takes the track into the gentle "Justified & Ancient" vocal line, which is syncopated similarly to African music and is at first a cappella.