They released six albums independently, all on their own label, Avenue Dreams. In 2004, they collaborated with Boy George's electroclash project, The Twin, by appearing on his album "Yum Yum", on the track "Fire-Desire". A mash-up of the duo's song "Do I Look Like a Slut?" with The Twin's "Here Come the Girls" was also made but remained unreleased until his 2010's compilation, named "Ordinary Alien". Norwegian musician Erlend Øye included Avenue D's song "2D2F" on of the "DJ-Kicks" compilation series, released on April 19, 2004.