Shortly after they married, Elizabeth and William moved into a fashionable residence on Wall Street. Socially prominent in New York society, the Setons belonged to Trinity Episcopal Church, near Broadway and Wall Streets. A devout communicant, Elizabeth took the Rev. John Henry Hobart (later bishop) as her spiritual director. Along with her sister-in-law Rebecca Mary Seton (1780–1804) (her soul-friend and dearest confidante), Elizabeth continued her former stepmother's social ministry—nursing the sick and dying among family, friends, and needy neighbors. Influenced by her father, she became a charter member of The Society for the Relief of Poor Widows with Small Children (1797) and served as its treasurer.