In 1845, land surveyor and early settler Barton Salisbury built a sawmill on the river north of West Bend. The community that grew around the mill was known as Salisbury's Mills before to the name was changed to Barton in 1853. Additional sawmills and gristmills sprang up on the river in the community's early years, and by 1855, Barton's population was over 1,000, making it larger than neighboring West Bend. Despite its early growth, however, Barton would be overshadowed by West Bend in the coming decades.