Egremont is situated in a valley east of the Taconic Range. To the southwest, Mount Whitbeck divides the town from Mount Washington, and to the west, Mount Fray and several other mountains divide the town from New York proper. Mount Fray is the site of the Catamount Ski Area, which extends into Hillsdale. Mount Whitbeck and its neighbor, the Jug End, make up the Jug End State Reservation and Wildlife Management Area. The Appalachian Trail extends through the reservation, before turning east at the Jug End towards Great Barrington. The town lies along the Green River, a tributary of the Housatonic River. Several brooks also flow through the town, with one being dammed to form the Mill Pond in South Egremont.