Since then, the group has released two compilations on Latino Buggerveil: 2002's "Humpty Dumpty LSD" is a compilation of studio outtakes, while 2003's "Butthole Surfers/Live PCPPEP", combines their first two Alternative Tentacles EPs. In 2004, Haynes formed Gibby Haynes and His Problem, who released an eponymous album on Surfdog Records later that year. While promoting the side project, Haynes indicated that another Butthole Surfers studio album was likely, and remarked that it would be "noisy". However, no release date has been announced.