She disclosed in her autobiography that she had an affair with actor Victor Mature while they were working on "Million Dollar Mermaid", citing that at the time her marriage was in trouble and, feeling lonely, she turned to Mature for love and affection, and he gave her all she wanted. The affair stopped while Williams was recovering from her fall during the shooting of "Million Dollar Mermaid." She was romantically linked with Jeff Chandler. She claims in her autobiography that Chandler was a cross-dresser and that she broke off the relationship. According to the "Los Angeles Times", many friends and colleagues of Chandler's rebutted Williams' claims. Jane Russell commented, "I've never heard of such a thing. Cross-dressing is the last thing I would expect of Jeff. He was a sweet guy, definitely all man."