In 1654, Harley married Mary Dutton, and they had four daughters before her death;  in 1661, Abigail Stephens became his second wife.
Harley wedded Mary Dutton in 1654, with whom he had four female offspring before her demise. He then married Abigail Stephens as his second partner in 1661.