Musical influences included Eno, Kraftwerk, Neil Young, Lou Reed, The Velvet Underground, Roxy Music, David Bowie, Can and others. The band were acquainted with Scritti Politti, the band of Cardiff native Green Gartside, and signed to the same label, Rough Trade Records. It was revealed in the 2003 book "Journals" that the band were, along with The Vaselines, Kurt Cobain's favourite band. Courtney Love's band Hole covered the Young Marble Giants track "Credit In The Straight World"; a cover version of their song "The Man Amplifier" was included on The Magnetic Fields single "Why I Cry" as a b-side. Stuart Moxham was a fan of Manchester guitarist Vini Reilly's early work, and was also very interested in dub reggae. Their single "Final Day" was covered by both Belle and Sebastian and Galaxie 500, and was included in "The Pitchfork 500".