Ellis's father was a general manager of the Metropolitan Railway in London. He went to Harrow School where he was very good at all subjects as well as sport. In 1913 he become a cadet in the Royal Military Academy. He wanted to join the Royal Engineers. 