Brownsville is located in central Haywood County. According to the United States Census Bureau, the city has a total area of , all land. U.S. Routes 70 and 79 form a bypass around the southern and eastern sides of the city. US 79 leads northeast to Humboldt, while US 70 leads east to Jackson. The two highways together leads southwest to Memphis. Interstate 40 passes south of Brownsville, coming closest at exits 56 and 60, where it is south of downtown.