On October 8, 2003, the album's track listing was revealed, followed by the album's title, "Guilt Show", on October 22. On November 11, the album was announced for release in March 2004. In early January, the album's artwork was posted on Vagrant Records' website. It was made by Sean T; Pryor found it to much simpler than the "incredibly complicated" artwork of "On a Wire". He thought the inside layout, which consists of a photo by Dan Monick, was reminiscent of "Twin Peaks". Also during January, the band were due to release an EP of two songs from the forthcoming album alongside alternative versions of other songs, but was cancelled when it was decided that the band would be better off releasing the songs online. "Martyr Me" was posted online as a free download on January 12, followed by "Wouldn't Believe It" on January 19.