Milsom began his career as a youth player at Fulham, which he joined since eleven, before he was promoted to the reserve team.
Milsom's early involvement in football was with Fulham, starting as a youth player at age eleven before being promoted to the reserve team.