Formed in August 1991 and taking their name from a song by the band The March Violets, Children on Stun appeared to enjoy a relatively large amount of success in a short period of time. Treen left within a year of the band forming. The band's first gig took place at a club called "The Crypt" in Hastings. In the same year, the band also recorded their first demo, entitled "Elegance", and also made an appearance in Mick Mercer's second book on the gothic rock genre: this boosted the band's popularity and gained them publicity.