He was married to Emily Nancy Bevill Pethybridge from 1930 until they divorced in 1944. He was married to Aileen Dickens Hawksley from 1944 until her death in 1961. Aileen was the granddaughter of Charles Dickens. Napier was a close friend of actor Michael Gough.