Mulgrew Miller was born in Greenwood, Mississippi, to parents who had been raised on plantations. He had three brothers and four sisters. His family was not musical, but they had a piano, which no one in the house could play. Miller, however, played tunes on the piano from the age of six, playing by ear. He had piano lessons from the age of eight. As a child, he played blues and rhythm and blues for dances, and gospel music in a church. His family was Methodist, but he played in churches of various denominations. His principal influence on piano at this stage was Ramsey Lewis.