He later formed a garage rock inspired band called Thee Milkshakes (1980–1984) with Mickey Hampshire, Thee Mighty Caesars (1985–1989), The Delmonas then Thee Headcoats (1989–1999). In 2000 he formed Wild Billy Childish & The Friends of the Buff Medways Fanciers Association (2000–2006), named after a type of poultry bred in his home town. The Buff Medways, or The Buffs, as they were sometimes affectionately known, split in 2006, and Wild Billy Childish & the Musicians of the British Empire were born, recording a song about one of Childish's heroes George Mallory titled "Bottomless Pit." In early 2007, Childish formed The Vermin Poets with former Fire Dept singer and guitarist Neil Palmer and A-Lines guitarist and singer Julie Hamper, his wife. Thee Headcoats began their monthly residency at the Wild Western Room in the St John's Tavern, north London, in the early 1990s, and continued after moving to the Dirty Water Club in 1996. The Musicians of the British Empire (MBEs) played at the venue more or less once a month until February 2011.