Following the 1862 Peninsula Campaign, Gen. Lee began to reorganize his army and eliminate ineffective division commanders, including Huger. His actions since joining the army "left much to be desired" according to military biographer Ezra J. Warner. Other historians have also criticized Huger throughout this time: Brendon A. Rehm summarized his battle performance as "not notably successful" and John C. Fredriksen stated Huger was "lethargic" during Seven Pines as well as moved "sluggishly" during the Seven Days fights. Furthermore, the Confederate Congress held Huger accountable for the defeat at Roanoke Island. His dilatory performance also appears to have been blamed on his rather advanced age; at nearly 57, he was well above the average age of most field officers. As a result, Huger was relieved of command on July 12, 1862 along with Maj. Gen. Theophilus Holmes, another aging, ineffective division commander. and that fall was ordered to serve in the Trans-Mississippi Department.