James and his twin brother John were the youngest of five children of Isabella and Robert Wilson, Scottish migrant workers in England. His father was a herdsman from Aberdeenshire. James and John were inspired to join the local athletics club by watching the 1908 Olympic marathon race that passed nearby their home.
James and his twin brother John, who were among Isabella and Robert Wilson's five children, Scottish migrant workers in England, found inspiration to join the local athletics club after seeing the 1908 Olympic marathon race nearby their residence.