The manor of Milford Montagu, which was held of the lords of Christchurch, seems to have originated in an estate held by William Spileman at his death in 1291. In the late 14th century it was part of the lands of William Montagu, 2nd Earl of Salisbury. In 1428 Thomas, the 4th Earl, died possessed of the manor, and was succeeded by his daughter Alice. By 1580 the manor had passed out of the hands of the Montagu family, and it was acquired in 1610 by Sir Thomas Gorges, who was succeeded by his son Sir Edward, Baron Gorges of Dundalk. In 1638 he sold it to Edward Hopgood. At the end of the 18th century the manor was purchased by Admiral William Cornwallis.