In 1880, Fulford married Mary Wilder White (1856–1946), a socialite from Wisconsin, and had three children. Dorothy Marston (1881–1949), their eldest, married Arthur Charles Hardy, son of former Ontario Premier Arthur Sturgis Hardy, in 1901 in a ceremony at Fulford Place, the family estate. Martha Harris (1883–1910) died young, while giving birth. The long-awaited male heir arrived much later and after one near-fatal miscarriage, when Mary Fulford was 46 years of age. George Taylor II (1902–1987) was a politician himself (Member of the House of Commons of Canada) and owned Fulford Place until his death.