During the 1600s the Manor estates changed hands several times. Thomas Morgan passed them to his daughter, who married Sir John Preston of Furness in Lancashire. From him the estates passed to his brother Sir Thomas Preston. In 1685 he settled the manors of Heyford and Nether Heyford on his daughter Mary, who married William Lord Herbert, son and heir of William, Earl of Powis. However, it is believed that the original Manor House building became derelict during this period. An entry in the Parish Registers of 1652 (during the Commonwealth period) states that the building was unoccupied and 'lying open to vagrants'.