The Priory was established by Sir William de Clinton, 1st Earl of Huntingdon in 1331 when he endowed a College of Priests consisting of five chaplains and a warden. It was built adjacent to an earlier moated farmstead, south of his castle towards Packington village. In 1336 it was expanded to a full Priory for Augustinian Canons and was completed in 1343. It was dissolved in 1536, when the buildings and lands were granted to Charles Brandon, 1st Duke of Suffolk.