The manor of Milford Barnes originally belonged to Christchurch Priory. After the Dissolution a twenty-one years' lease of "the site of the manor with the appurtenances and all land and fisheries belonging, together with 20 acres in Shorefield," was in 1557 granted to John Wavell, and in 1574 a similar lease was granted to John Rowe. Sir Thomas Gorges owned the estate in 1611, and from that time its descent was the same as that of the manor of Milford Montagu.