The Native Americans called the lake "Oussuk", meaning "stony pond." The Dutch settlers called it "Binnin", meaning "water within land" or "water between other waters". In 1684, Gov. Thomas Donegan purchased the lake and surrounding territory from the Native Americans and divided this patent into numerous farms, most especially dairy farms. At the time of the Revolutionary War, a man named Capt. Thomas Machin owned and operated a saw mill, grist mill, and finally a mint in what is now the hamlet, at the very beginning of the outlet stream. An historical marker marks the site of Machin's Mill on Lakeside Road. At that time, the lake began to be called Machin's Pond. In the 1830s, a local clergyman named James R. Willson began calling the lake Orange Lake. The reasons for this name change remain obscure, but are probably related to its location in Orange County. One source claims that the fact that the lake was round like an orange was also a factor. Local legend states that many residents objected to this name change, but it did stick and remains the name of the lake and the hamlet to this day.