The band had been playing together for six months when they had their first recording session with Kramer at Noise NY, New York in July 1991 and recorded fourteen songs over the course of three hours, "only doing second takes here and there, we didn't even go to the mixing board". This session was issued in its entirety as the first album by The Jon Spencer Blues Explosion, "A Reverse Willie Horton". This was an unofficial album issued by "Pubic Pop Can", at some point between late 1991 and early 1992, in an edition of 500 or 1000 copies (the figure varies between sources). It has been suggested that the source of the bootleg was a dubbed copy of a cassette that Jon Spencer let somebody copy during a tour with the Gibson Bros. in August 1991.