Pough, who was born on February 16, 1948, in Jacksonville, Florida and was the first of nine children, grew up in an area near Florida Community College at Jacksonville. As a child, Pough suffered from asthma and he had a close relationship to his mother, whom he helped out a lot after his father left the family in 1959. He attended a vocational school, but dropped out in his sophomore year. At the age of 18, he began working as a common laborer, which he remained as until his death.