The village prospered until 1852 when the sawmills burned to the ground rendering Frederick a ghost town.
Prior to the War of 1812 a sawmill was likely built in the town, another sawmill was constructed around 1826 by Job C. Smith.