At one time, Austwick, Clapham, Lawkland, and Newby were independent manors with their own lord that together formed the larger parish of Clapham. In the "Domesday Book", which was a survey of England conducted in 1086, Austwick was the head of 12 manors spread along a northern route. Austwick still has a lord of the manor; the most recent holder of the position was Dr. John Farrer, who died in 2014. The Farrer family has had the position of lord of the manor since 1782. Austwick Hall, a grade II listed building, is said to have originally been part of a pele tower. The building was renovated in the 17th and 19th centuries, though evidence of its purchase by the Ingilby family exists pointing to the year 1573.