He was married to actress Aileen Raymond (1910-2005) from 1927 until they divorced in 1941. He was married to actress Mary Hayley Bell (1911-2005) from 1941 until his death. The couple had two daughters, actresses Juliet Mills (born 1941) and Hayley Mills (born 1946) and a son, Jonathan Mills (born 1949).