Between 1951 and 1954 Clarke recorded with Miles Davis, including tracks that appeared on the 1957 compilation albums "Bags' Groove" and "Walkin, along with 1959's "Miles Davis and the Modern Jazz Giants". Korall described these recordings as "his best work of the 1950s – perhaps of his entire career", writing: "Clarke follows feelings, lives inside the pulse, defining the contours, dynamics, and implications of each solo and each piece. Like Dave Tough, he is a totally unselfish player – nonintrusive yet spirited and spiritual." In mid-1955 he rejoined Pettiford's group at Café Bohemia, later working with him and pianist Phineas Newborn Jr. at Basin Street West and recording with Pettiford on Newborn's 1956 album "Here Is Phineas". During this period he was the resident drummer and a talent scout for Savoy Records, introducing the label to artists such as saxophonists Cannonball Adderley and Pepper Adams, and trumpeter Donald Byrd. He often worked with recording engineer Rudy Van Gelder, who dubbed Clarke's location in his studio "Klook's corner".