When Fort Cumberland was all but abandoned in 1763, the Ohio Company reclaimed the land and put it up for sale. Eventually, the land was conveyed to James McCubbin Lingan in 1785, then to Captain George Calmes in 1803. Calmes built a mansion on the property. The land and home passed down through George Calmes' family through most of the 1800s. Late in that century, portions of the town began to be subdivided for housing and business use. In 1905, a group leased the Calmes Mansion and created the Potomac Club, which operated in Ridgeley as an important tennis and boating club until 1919.