Having lost his first wife in the birth of their second child, he later married Marjorie Fuller Ryan, with whom he had 4 sons, John Fuller Ryan, Geoffrey Fuller Ryan, Jeremy deMarsh Ryan, and Joseph deMarsh Ryan.
Following the death of his first wife during childbirth, he later married Marjorie Fuller Ryan, with whom she had four sons named John Fuller Ryan, Geoffrey Fuller Ryan, Jeremy deMarsh Ryan, and Joseph deMarsh Ryan.