Savoy is located along the eastern border of Berkshire County, and shares a border with Franklin County and Hampshire County. The town is bordered by Florida to the north, Charlemont, Hawley and Plainfield to the east, Windsor to the south, Cheshire to the southwest, and Adams to the west. Charlemont and Hawley are both located in Franklin County, and Plainfield is in Hampshire County. Savoy is northeast of Pittsfield, northwest of Springfield and approximately west by northwest of Boston (although it is closer to both Hartford and Albany than its own state capital).