US 123 and SR 184 gain a center turn lane and cross a Norfolk Southern rail line as they approach the downtown area. In the center of town, the highway begins to parallel the Greenville District rail line and intersects Broad Street, which carries SR 63 and SR 106 south of the intersection and SR 184 to the north. US 123 passes the Toccoa Amtrak station and intersects SR 17 Alternate (Big A Road), where the center turn lane ends. The highway passes Toccoa Airport and veers away from the railroad on the eastern edge of the city. US 123 passes by the historic site Travelers Rest before crossing the Tugaloo River branch of Lake Hartwell into Oconee County, South Carolina. The highway parallels the left bank of the lake to the mouth of the Chauga River, then curves north and crosses over the Greenville District before entering the town of Westminster, where the highway intersects US 76 (North Avenue).