Wishing to return to the east coast, Clark served as accompanist for singer Dinah Washington in February 1957 in order to relocate to New York City. In New York, Clark was often requested as a sideman by many musicians, partly because of his rhythmic comping. He frequently recorded for Blue Note Records as one of their house musicians, playing as a sideman with many hard bop players, including Kenny Burrell, Donald Byrd, Paul Chambers, John Coltrane, Dexter Gordon, Art Farmer, Curtis Fuller, Grant Green, Philly Joe Jones, Clifford Jordan, Jackie McLean, Hank Mobley, Art Taylor, and Wilbur Ware. He also recorded sessions with Charles Mingus, Sonny Rollins, Billie Holiday, Stanley Turrentine, and Lee Morgan.