A raiding party of Union cavalry, under the command of Colonel Benjamin Grierson, is known to have camped in the county nine miles east of Liberty on the evening of April 28, 1863, while conducting a deep penetration raid as part of the Vicksburg Campaign. As part of that raid, Union forces pillages many homes and plantations. Most of the buildings of the Amite Female Seminary, with 13 pianos, were burnt; one building was spared, the small Mary Van Norman Ratcliff Building, commonly known as the "Little Red Schoolhouse."