In 2002, he went solo, adopting the name Duke Special, and began building up a following as a live performer. He released three EPs on Medieval Haircut Records, the first two of which, "Lucky Me" and "My Villain Heart", were collected as an album, "Adventures in Gramophone", released by Hag Records in 2005. The album was nominated for the 2006 Choice Music Prize. In 2006, he signed to V2 Records and released a second album, "Songs from the Deep Forest". He featured on Later... with Jools Holland alongside Amy Winehouse and John Legend the following November and the album was nominated for the 2007 Choice Music Prize. Duke Special was nominated for three 2007 Meteor Music Awards, for best Irish male, best newcomer, and best album for "Songs from the Deep Forest". In 2007, he headlined a concert with the Ulster Orchestra at Belfast's Waterfront Hall, "Orchestral Manoevres". The concert was supported by Julie Feeney and Foy Vance, who sang on "This Could Be My Last Day". 2007 also saw him perform at Greenbelt festival, Glastonbury, Guilfest, Summer Sundae, Haldern Festival and the Electric Picnic. Additionally in 2007, he performed as part of the BBC Electric Proms, supporting former Kinks lead singer Ray Davies, and he supported Crowded House during ten tour dates, culminating with a concert at Royal Albert Hall in December.