In 1953 Ballard joined the Royal Air Force and was sent to the RCAF flight-training base in Moose Jaw, Saskatchewan, Canada. He left the RAF in 1954 after two years and returned to England. In 1955 he married Helen Mary Matthews and they lived in Chiswick.