Continuing north, NY 180 enters the town of Brownville, crossing through the rural town as a two-lane road. The route makes a bend to the northeast and enters the hamlet of Limerick, where it crosses a junction with NY 12E. Now paralleling the Perch River, NY 180 runs northeast through the fields, reaching a junction with CR 54 (Depauville Road). After CR 54, NY 180 bends northward, bypassing the hamlet of Perch River, where the namesake waterway merges into Perch Lake. NY 180 bends northeast again, crossing a junction with CR 128 and entering the town of Clayton.