Walker served as a chief of staff for Martin Luther King, Jr.. In 1958,Walker became an early board member of the Southern Christian Leadership Conference (SCLC). He helped found a Congress for Racial Equality (CORE) chapter in 1958. As executive director of the SCLC from 1960 to 1964.