Born in Woolston, Southampton, Parker began playing with local sides, such as Sholing Rangers and Sholing Athletic , before joining Southern League side Southampton as an amateur in 1918, just before the end of the First World War. In his first season for the Saints, he was playing in the War League and in friendlies, and made a total of 39 appearances, scoring 12 goals, of which 10 were penalties, thus making him the club's second highest scorer behind Bill Rawlings. In 1919, after the end of hostilities, professional football restarted and for the next seven seasons he was a virtual ever-present at right back, forming a successful full-back partnership with Fred Titmuss.