Gosse married Ellen Epps (23 March 1850 – 29 August 1929), a young painter in the Pre-Raphaelite circle, who was the daughter of George Napoleon Epps. Though she was initially determined to pursue her art, she succumbed to his determined courting and they married in August 1875, with a reception at the house of Lawrence Alma-Tadema (her brother-in-law) and visiting Gosse's parents (who did not attend the registry office wedding) at the end of their honeymoon in Devon and Cornwall. She continued to paint and wrote stories and reviews for various publications. In 1907, she inherited a sizeable fortune from her uncle, James Epps (the brother of John Epps and who had made his fortune in cocoa).