The new county was named for James Madison, co-author of "The Federalist Papers" and the fourth President of the United States (1809 to 1817). The then-small settlement of Pendleton was named as the county, but its non-central location soon fostered a desire for a more central location as the county seat. After considerable local competition, the town of Anderson was platted in 1827 on donated land with the stipulation that the seat be moved to that location. This move began in 1828 and was completed by 1836.