Norsworthy House (250 King St. E.) was home to the family of James Counter Norsworthy (1846–1936). James, native of Devonshire, England, had moved to the Thamesford area in 1852, entered the insurance business, and in 1876 removed to Ingersoll, where he became an inspector for the North British Mercantile Insurance Co. Norsworthy acquired his house in 1878, as part of a dowry from his marriage to Mary Jane Cuthbert (1853–91). James had four sons and a daughter by his first wife, Mary Jane. After her death in 1891, at the age of 38, he remarried to Mrs. John T. MacDonald of Sarnia in 1895.