The village is split into two distinct sections with Washington Street being the only main east–west oriented avenue connecting them. In between the two sections is the elevated New York Central Railroad bed, now the Tunnel Hill State Trail, on a large swath of grass, and the now defunct streetcar bypass on Carline Street, splitting the village in a southwest to northeast angle. Downtown is located in the southwest corner, the largest section of the village to the northwest, and East End to the southeast, US Route 45 borders the southern edge, giving Carrier Mills its distinctive 'L' shape.