In 1959, Carroll began a nine-year affair with the married actor Sidney Poitier. In her autobiography, Carroll said Poitier persuaded her to divorce her husband and said he would leave his wife to be with her. While she proceeded with her divorce, Poitier did not keep his part of the bargain. Eventually he divorced his wife. According to Poitier, their relationship ended because he wanted to live with Carroll for six months without her daughter present so he would not be "jumping from one marriage straight into another." She refused.