Pat Dye played high school football at Richmond Academy in Augusta, Georgia, from 1954-1956 where he was selected All-American and All-State while leading the team to the 1956 3A state championship, serving as team captain. He placed 2nd in the state tournament in shot-put and javelin, on the State Championship Track Team. Following this success, "The Atlanta Journal-Constitution" selected Dye as Georgia's 3A Lineman of the Year for 1956 before being recruited to the University of Georgia where he followed his older brothers, Wayne and Nat.