Ammons was the son of a couple which both played piano. So he started at the age of ten with piano lessons. After the First World War, he became interested in blues. He was influenced by Hersal Thomas and Jimmy Yancey. At the beginning of the 1920s, he worked as taxi driver where he met another pianist, Meade Lux Lewis. They formed a team and played at clubs and parties.