As a youth attending Eton College as a King's Scholar, Stephen's prodigious size and physical strength helped him prove himself an outstanding player of the Eton Wall Game, representing the Collegers (King's Scholars) on St. Andrew's Day from 1874 to 1877 and leading the team to victory as Keeper of the College Wall in his final two years. He has been commemorated in a toast raised by College Wall on the eve of St Andrew's Day every year for over a century: ""In Piam Memoriam J.K.S.""