In 2003, the band signed a deal with Reprise Records. Following a tour with Avenged Sevenfold, the band began working on their second album, which was titled "Three Cheers for Sweet Revenge", which was released on June 8, 2004. A month after the album's release, the band replaced Matt Pelissier with Bob Bryar. The band released four singles from the album: "I'm Not Okay (I Promise)", "Thank You for the Venom", "Helena", and "The Ghost of You". The album went platinum in just over a year of its release.