In 1994, Hersh began a solo career on Sire/Reprise and 4AD as an acoustic performer, beginning with "Hips and Makers", an album sparsely arranged around her vocals, guitar, and a cellist, in contrast to the volatile, electric sound of her band work. Michael Stipe of R.E.M. made an appearance on this first solo album. After receiving some airplay and major media coverage for the Throwing Muses album "University" in 1995, Hersh moved to Rykodisc for the band's 1996 album, "Limbo", and released her solo album, "Strange Angels" in 1998.