In 1866, he married Fanny Lucinda Cooke, who died the following year. In 1868, he married Mrs. Phila (Wilkin) Fargo, who died only two years later. On April 26, 1875, at Andover, Massachusetts, he married Adelaide Brewster Taylor. She was born on January 14, 1845 at Rochester, Monroe County, New York; and died on January 24, 1929 in Piedmont, Alameda County, California. She was the daughter of Dr. Oliver Brewster Taylor, an 1848 graduate of Harvard University, and Sophia Hale Hubbard. She was the great granddaughter of Dr. Oliver Wadsworth Brewster, who served in Col. John Brown's regiment in the American Revolutionary War and was the first physician in Becket, Massachusetts. His home, built in 1786, is still standing and is currently occupied by the Becket-Chimney Corners YMCA.