The Presbyterian Church is the most prominent feature in Stillwater village. Opposite the church is the former Stillwater Academy, an old schoolhouse that is now home to the Stillwater Historical Museum. Stillwater was, and still is, primarily agricultural. The area is dotted with lime kilns, which used to burn lime to enrich the soil, but are now obsolete, becoming lost to history and the overgrowth of vegetation. An intact kiln still exists on Millbrook Road, a little more than two miles (3 km) from Stillwater village.