The album has a different sound than their previous two studio album releases "A Fever You Can't Sweat Out" (2005) and "Pretty. Odd." (2008). That is because two group members had left, and because of the amount of time between the releases of "Vices" and "Pretty. Odd." The album has elements from the band's debut album. It has heavy use of synthesizers and guitars. The track "Mona Lisa" returns to the idea of the band's first single "I Write Sins, Not Tragedies", which had heavier guitar and rock influences.