Downes was born in Birmingham, England. His father worked in a bank. He left school when he was 14 and got a simple job in a gas store where he earned 16s 10d (16 shillings and 10 pence, which is 84p in modern British money) a week. 