In 1949, Ross had a brief affair with drummer Kenny Clarke. This affair produced a son, Kenny Clarke Jr. (born 1950), who was raised by Clarke's brother and his wife. During her time with Lambert, Hendricks & Ross, she became addicted to heroin and in the late 1950s had an affair with the comedian Lenny Bruce, who was also having drug problems. By 1960, Carol Sloane was substituting for her on tour. After a performance by the trio in London in May 1962, she remained in London to confront her drug addiction.