In 1821 Huger entered the United States Military Academy at West Point and graduated four years later, standing eighth out of 37 cadets. On July 1, 1825, he was commissioned a brevet second lieutenant, then promoted to second lieutenant in the 3rd U.S. Artillery on that same date. He served as a topographical engineer until 1828, when he took a leave of absence from the Army to visit Europe from 1828 to 1830. He then was on recruiting duty, after which he served as part of Fort Trumbull's garrison in New London, Connecticut. From 1832 to 1839 Huger commanded the Fortress Monroe arsenal located in Hampton, Virginia.