In the early summer of 2004, when Pete Doherty once again found himself cast out of The Libertines because of his drug use, he brought Babyshambles to the fore with Walden on lead guitar. The band's line-up underwent several changes before stabilizing during the late summer of 2004 with Doherty on vocals, Patrick Walden on guitar, Gemma Clarke on drums and Drew McConnell on bass. Walden co-wrote a number of Babyshambles songs with Pete Doherty. One of them, "The Man Who Came To Stay," was released as the B-side to the Killamangiro single in November 2004. Other Doherty/Walden compositions include Top-10 single "Fuck Forever" and "Loyalty Song," "352 Days," "In Love With a Feeling," "Up the Morning," "Pipe Down," "32nd of December," and "8 Dead Boys." He co-wrote six of the sixteen tracks that made it onto "Down In Albion", Babyshambles' debut album.