 Her father was Dr. Cornelius Baldwin (d. 1828), of Winchester, Virginia.Her mother was Nelly Conway Hite (d. 1830), (daughter of Maj. Isaac Hite, of Belle Grove).Nelly was a niece of James Madison, fourth President of the United States.