During the 19th century, the shores of the lake became a popular location for summer cottages. Transportation to the lake and the hamlet was difficult until 1895, when trolley service was established between the City of Newburgh and the Village of Walden, and Orange Lake, approximately the halfway point, became a popular stop. Soon after this Newburgh and Walden Electric Railway initiated service, a highly successful amusement park opened on the south shore of the lake. The trolley line went out of business in 1926. The amusement park went out of business during the Great Depression and was demolished in 1941.