The Edwards family later moved to 31 Elm Road on the Priory Estate, also in Dudley. Edwards attended Priory Primary School from 1941 to 1948, and Wolverhampton Street Secondary School from 1948 to 1952. He played football for his school as well as for Dudley Schools, Worcestershire and Birmingham and District teams, and also represented his school at morris dancing. He was selected to compete in the National Morris and Sword Dancing Festival, but was also offered a trial for the English Schools Football Association's under-14 team, which fell on the same day, and opted to attend the latter.