During the 1560s there was an ongoing dispute with the Ipswich Corporation in relation to various alterations carried out and public access to the annual fair. In 1567 Edmund Withypoll constructed a new pond, now known as the 'Wilderness Pond'. Queen Elizabeth I stayed at the mansion for six days during August 1561. She returned to the town for four days in 1575.Edmunds's granddaughter Elizabeth Withipoll married Leicester Devereux, 6th Viscount Hereford and the mansion passed to the Devereux family, who rebuilt the upper floors after a fire in about 1670, when the main porch was also added. Claude Fonnereau bought the Christchurch estate in 1734 which at the time totaled more than of land (today's park covers about 82 acres). By 1772 the public were granted some access to the park and tried to introduce keys for those who would sign an agreement with conditions of entry.