Smith married Ethel Georgina Reynolds (born October 23, 1889), the daughter of prominent LDS Church leader George Reynolds, on November 2, 1908. They had four girls (Emily, Naomi, Lois, and Amelia) and five boys (Joseph Fielding (often called Joseph Fielding Smith, Jr.), Lewis Warren, George Reynolds, Douglas Allan, and Milton Edmund). Their youngest daughter, Amelia, married Bruce R. McConkie, who was named to the Quorum of the Twelve Apostles shortly after Smith's death. Ethel died of a cerebral hemorrhage on August 26, 1937, at age 47.