Caine had an elder maternal half-brother named David William Burchell, and a younger full brother, Stanley Micklewhite. He grew up in Southwark, London, and during the Second World War, he was evacuated to North Runcton near King's Lynn in Norfolk where he had a pet carthorse called Lottie. After the war, his father was demobilised, and the family were rehoused by the council in Marshall Gardens at the Elephant and Castle in a prefabricated house made in Canada, as much of London's housing stock had been damaged during the Blitz in 1940–1941: