O'Toole was married to Siân Phillips from 1959 until they divorced in 1979. O'Toole had three children; two daughters with Phillips (Kate and Patricia) and a son by his girlfriend Karen Brown (Lorcan Patrick O'Toole). O'Toole lived in London, England. He was lifelong friends with Irish actor Richard Harris until Harris' death in 2002.