Twitty was married four times, to three different women. His first marriage, to Ellen Matthews, lasted from 1953 to 1954. They had married because Ellen was pregnant with his son, Michael. His second, and longest, marriage was to Temple "Mickey" Medley. They were married in 1956 and had three children: Kathy, Joni Lee, and Jimmy Twitty. The couple were divorced in early 1970, but they remarried quietly by the end of 1970. By 1984, after 28 years of marriage on and off, the stress of Twitty's frequent absences took its toll on Mickey, and she and Conway divorced for good. In 1987, Twitty married his 36-year-old office secretary, Delores "Dee" Henry. They were married until Twitty's death.