He was the first black lawyer in Richmond, California. In 1961 Carroll became the first African American elected to the city council (1961–1964) and later became the first black mayor of Richmond (1964–1965) or any large American city.