In August 1990, the new band released their first single, "Government Wall", a re-recording of the Berrie song. In October, they released their debut album, "Humanity", which also featured a number of Berrie songs and retained their punk sound. After the album's release, original guitarist Minoru Kojima left the band, and was replaced by former roadie Ai Ishigaki. The following year, The Mad Capsule Markets signed to major record label Victor Entertainment and recorded their second album, "P.O.P". A faster and harder album than their first, it was heavily censored, provoking outrage from the band members. Their earlier lyrical content, with the lyrics wrote mostly by bassist Takeshi Ueda had Marxist/working-class influences, with lyrical themes becoming more and more political with later releases. From 1990 their sound was mainly punk influenced but quickly began to incorporate different influences in their music by the likes of Killing Joke, Aburadako, The Stalin and Yellow Magic Orchestra.