In late May 1963, he formed The Yardbirds with Keith Relf, Anthony Topham, Chris Dreja, and Jim McCarty. He mainly used an Epiphone Rivoli bass. He played on the UK albums, "Five Live Yardbirds" and "Yardbirds" (also known as "Roger the Engineer") and on the US albums "For Your Love", "Having a Rave Up", and "Over Under Sideways Down" (which was "Roger the Engineer" retitled for the US market), all released on Epic Records. He provided background vocals on many songs like "Good Morning Little School Girl", "For Your Love", "Heart Full of Soul", "Evil Hearted You", and more. He composed the Gregorian chant arrangements and lyrics of the songs "Still I'm Sad" and "Turn Into Earth". While in the Yardbirds he started working on the technical side in the studio. In 1966, becoming tired of touring and wanting to focus on production, he left the Yardbirds and was replaced by Jimmy Page. The last Yardbirds album he played on was "Roger the Engineer".