By 2002, the band had released its debut album, "Hillbilly State of Mind"; a second album, "Don't Look Back", followed two years later on Cort Records. Although neither album produced any chart singles, the albums sold more than 10,000 copies nationwide; as a result, they were named by the Country Music Association as one of the top-selling independent country acts of 2005. Crafton was forced out of the group by Rust Records in 2006,allowing them to be signed to Rust Records and released their self-titled third album. This album produced non-charting singles in "Mr. Right Now" and "One Night in New Orleans", the latter of which was previously recorded by Blackhawk. The Povertyneck Hillbillies left Rust in 2007.