Byard also continued to play and record with other leaders. While in Europe in 1965, he joined Art Blakey's band for a series of concerts there. In 1967 Byard played in a small group with drummer Elvin Jones. Between 1966 and 1969 Byard recorded three albums with the saxophonist Eric Kloss, then, in 1970, returned to Mingus' band, including for performances in Europe. Byard occasionally substituted on piano in Duke Ellington's orchestra in 1974 when the leader was unwell. In 1974–75 Byard had a residency at Bradley’s in New York. He also fronted a big band, the Apollo Stompers, which was formed in the late 1970s. There were two versions of the band: one made up of musicians in New York, and the other using students from the New England Conservatory of Music, where Byard had taught from 1969.