Their next record was the debut studio album "That's Not What I Heard", released by the label Kill Rock Stars on January 23, 2001. They followed it with the EP "Arkansas Heat" on May 7, 2002. "Movement", their second studio album, was released on May 6, 2003. In November 2003, two months after the release of their first live album "Undead in NYC" on September 9, drummer Kathy Mendonça left the band to pursue a career as a midwife. Established punk drummer Hannah Blilie joined to replace her. The band then dropped "The" from their name, continuing as plain "Gossip".