Byard played with trumpeter Maynard Ferguson in the late 1950s and early 1960s, and was a member of bands led by bassist Charles Mingus for several years, including on several studio and concert recordings. The first of his recordings as a leader was in 1960, but, despite being praised by critics, his albums and performances did not gain him much wider attention. In his 60-year career, Byard recorded at least 35 albums as leader, and more than 50 as a sideman. Byard's influence on the music comes from his combining of musical styles during performance, and his parallel career in teaching.