Hoge was born near Hogestown in the Province of Pennsylvania. He served in the Revolutionary War as ensign in the Ninth Pennsylvania Regiment.
In 1782 he moved to what is now Washington, Pennsylvania, which he and his brother, William Hoge, founded. He was a delegate to the State constitutional convention in 1790, and a member of the Pennsylvania State Senate from 1790 to 1795.