Yamagata became the vocalist for the Chicago group Bumpus and spent six years touring, writing and recording with the band before leaving in 2001 to begin a solo career. In September 2002, she obtained a two-record deal with Arista's Private Music and her self-titled EP produced by Malcolm Burn, "Rachael Yamagata EP" was released in October. Her first full-length album, "Happenstance", followed in 2004. The album was produced by John Alagía at Compass Point Studios. Between 2003 and 2005, Yamagata played venues such as Amoeba Records and The Hotel Café, both in Hollywood.