Due to the importance of the B&O and Northwestern Virginia Railroads for the movement of troops and supplies, Grafton became an early strategic target during the Civil War; both sides tried to control it. CSA General Robert E. Lee initially vowed to protect the railroad, and sent first CSA Major Francis M. Boykin Jr., then CSA Col. George A. Porterfield (a Virginia Military Institute graduate from Charles Town across from Harpers Ferry) to recruit at Grafton, but neither had much success. Most Grafton residents, immigrants brought in to work for the railroad, sided with the Union. The Grafton Guards led by Col. George R. Latham became Company B of the 2nd West Virginia Infantry Regiment days after Virginians (over the objection of most of western Virginia) voted for secession on May 23.