Carmichael was born in Quincy, Illinois, the son of a Pentecostal minister, who allowed his son to play the violin and listen to the radio. "I was captivated by the chordal explosions I heard on the radio. I felt a sadness that we didn't have that in our church. Our church orchestra sounded weak and terrible by comparison. It was embarrassing. Why? Why did we have to settle? Why couldn't we use those gorgeous rhythms, sweeping strings, the brass, the stirring chords? That started to control everything I did."