Lipton was born on September 19, 1926 in Detroit, Michigan and studied at Central High School and Wayne State University for a year. Lipton was married to Nina Foch from 1954 until they divorced in 1959. He married Kedakai Turner in 1970.