He married Orline Walton, an amateur painter. The walls of their apartments at the Riggs were adorned with beautiful specimens of her work. She painted portraits of herself and her husband, and has also made copies of several of the celebrated pictures at the Corcoran Art Gallery, while her china painting was exquisite. Orline Walton was a native of Aberdeen, Mississippi. During her childhood, her father moved with his family to Bastrop, Texas. She was married to Hon. Joseph D. Sayers when he was Lieutenant-Governor of the State, and the first years of her married life were spent at Austin. She was a member of the Methodist church and interested in its benevolent and educational work.