Green first performed in a professional setting at the age of 13 as a member of a gospel music ensemble. His influences were Charlie Christian, Charlie Parker, Lester Young, and Jimmy Raney, he first played boogie-woogie before moving on to jazz. His first recordings in St. Louis were with tenor saxophonist Jimmy Forrest for the United label, where Green played alongside drummer Elvin Jones. Green recorded with Jones for several albums in the mid-1960s. In 1959, Lou Donaldson discovered Green playing in a bar in St. Louis hired him for his touring band. Green moved to New York at some point during 1959–60.