In September 1850 Harvey was described as being an apprentice shoemaker in the Horace Sheldon household in Blissfield, Lenawee County. His apprenticeship was probably because he could not do farm-work. He completed his apprenticeship during the 1850s and in 1860 he was living near Edgerton, St. Joseph Township, Williams County, Ohio, and working as a shoemaker. On December 26, 1861, he married Ellen E. Young in Bryan, Williams County, Ohio. He got into politics in Williams County and ran for, and was elected to, several local offices, including County Recorder in 1860, Justice of the Peace (Magistrate) in 1860, and Notary Public for Williams County in 1866.