After his release from the hospital, he played drums with Benny Carter's band, but decided to give up drumming as a vocation after hearing Max Roach, who replaced him in the orchestra. Inspired by hearing Thelonious Monk's "'Round Midnight", Russell moved to New York in the early 1940s, where he became a member of a coterie of young innovators who frequented the 55th Street apartment of Gil Evans, a clique which included Miles Davis, Charlie Parker, Gerry Mulligan, and John Lewis, later the music director of the Modern Jazz Quartet.