Grace played bass in a band called the Adversaries with Dustin Fridkin and a "revolving cast" of drummers from 1994 to 1996. The lineups were not stable, and the band had various names, including the Snot Rockets, Upper Crust, and eventually the Adversaries. The Adversaries released one (obscure) demo. Their "crowning achievement as a band" (according to Grace) was playing at "The Hardback" in Gainesville, FL. The breakup of the Adversaries led to Grace briefly playing in a band called Common Affliction in 1996. The ending of Common Affliction led to Grace recording the first Against Me! demo tape in December 1996.