After one month of service he was made a commissary sergeant and then he and his regiment were captured by Confederate forces at the Battle of Harpers Ferry. Hoyt was mustered out on October 3, 1862, and he reenlisted as a commissary sergeant in the 2nd Ohio Heavy Artillery.
Hoyt's military service took an unexpected turn when he became a commissary sergeant after just one month of duty. His regiment was captured by Confederate forces at the Battle of Harpers Ferry, leading to his discharge on October 3, 1862. He later rejoined as a commissary sergeant in the 2nd Ohio Heavy Artillery.