Sutherland was married to Lois Hardwick from 1959 until they divorced in 1966. Then he was married to Shirley Douglas from 1966 until they divorced in 1970. Since 1972, Sutherland has been married to his current wife Francine Racette. He has five children, three of whom are actors.