On June 30, 1831, Lee married Mary Custis at Arlington House. She was the granddaughter of George Washington's stepson, John Parke Custis. They made their home at Arlington House. They had seven children.