Yancey was born in Chicago in 1895 or 1898. His older brother Alonzo Yancey was also a pianist ; their father was a guitarist. Yancey started his career as a singer in traveling shows. He was a well known pianist by 1915, and influenced younger musicians, such as Meade Lux Lewis and Albert Ammons.