The manor was held by Elias de la Falaise at his death in 1254, and his brother William died in possession of the manor in the same year. Before 1277 the property had escheated to the Crown by the felony of William de la Falaise, grandson of William, and was granted in that year to Sir William le Brune, chamberlain to the king. The manor then stayed solidly in the Brune family until the death of Charles Brune in 1769, when the family became extinct in the male line. By his will his estates eventually devolved onto his grand-nephew the Rev. Charles Prideaux-Brune of Prideaux Place, Padstow, Cornwall, and the manor then remained in the possession of the Prideaux-Brune family.