Ford's first step into organised team football came with local Swansea based side Tower United, joining the club at the age of 15 as a full-back. Despite his young age, he played for the senior men's side in local amateur leagues where he attracted scouts from several clubs. The scouts included Albert Lindon of Arsenal, who invited Ford and teammate Frank Davies to attend a trial in Cardiff. Ford impressed enough to be offered an amateur contract with the London-based side, which was initially to be withheld until the end of hostilities in the Second World War. However, Ford himself rejected the contract as he felt he was too young too move away from his home and family.