In June 1805, he married Madame Marie Louise Magdaleine Valentine "Louise" (née d'Avezac) de Castera Moreau de Lassy (1785–1860), a widow who was then only 19 years of age, and a refugee in New Orleans from the Haitian Revolution. She was the daughter of a wealthy landowner and the sister of Auguste Davezac, a politician and diplomat who served twice as U.S. Minister to the Netherlands. She was a woman of extraordinary beauty and intellect: "the lady name is short, but she is said to be majestic in her person and elegant in manners with a long purse". She is said to have greatly influenced her husband's public career. Together, Louise and Edward were the parents of two children, only one of whom lived to adulthood: