Rotheray joined his first band when he was aged 13; it was called Mammoth, at one time performing the then-current Sex Pistols song, "Pretty Vacant" at a school concert, without any microphones. At that time Rotheray's musical tastes were for progressive rock, his favourite being Pink Floyd. His parents were worried but still allowed him to play and drove him to clubs to perform. Eventually, Mammoth evolved into a band called The Newpolitans. Both Mammoth and the Newpolitans featured Hugh Whitaker on drums, who later became the drummer for The Housemartins. The Newpolitans also later featured Dave Hemingway on drums, who also became drummer for the Housemartins and then a singer with the Beautiful South.