Clarence Alexander Avant was born in Greensboro, North Carolina, he was the oldest of eight children. He attended a one-room school in Greensboro until the ninth grade. He spent his freshman and second years of high school at Dudley High School in Greensboro before moving to New Jersey in 1947 as a teenager. In New Jersey, Avant worked as a stock clerk at Macy's and for a law directory. He began in the music business in the 1950s as a manager of Teddy P's Lounge in Newark, New Jersey, owned by promoter Teddy Powell.