Hickory Valley's origin dates back to the blending of three independent pioneer settlements in the area that were founded by three men: William Shinault in 1820, Drury Wood in 1826 and William Barnett in 1827. The Shinault Settlement formed before Hardeman County was organized and featured the first school in Hardeman County, which operated as early as 1823. The main buildings of the settlement were located one mile southwest of the present town and a former Indian trail and the historical Boliver-LaGrange Road are still visible in some places south of Hickory Valley. In 1826 Drury Wood migrated to the area and founded the Hickory Valley settlement; a cemetery for the Wood family is still located in the area and marks the original site of the settlement. William Barnett would move into the area in 1827 and would establish Mt. Comfort Church and a campground about two miles west of the present town. The Chickasaw also resided in the area.