Sweeney's high school band Skunk released two albums on Twin/Tone records ("Last American Virgin" in 1989 and the posthumous "Laid", both out of print). In the nineties he recorded and performed as a singer and guitarist with math rock band Chavez, releasing a seven-inch ("Repeat the Ending" b/w "Hack the Sides Away") two albums (1995's "Gone Glimmering" and 1996's "Ride the Fader") and one EP (1995"s "Pentagram Ring") on the Matador label. Chavez did several short tours in the United States and Europe between 1994 and 1997. When Chavez slowed down Sweeney filled in on bass guitar for Guided By Voices on the "Under the Bushes, Under the Stars" tour. He also provided vocals on the song "Quicksilver" on Guided By Voices leader Robert Pollard's first solo album "Not In My Airforce" LP. The late '90s found him continuing to work a day job and touring with Bonnie 'Prince' Billy as a guitarist.