The original medieval manor house was gradually replaced by later buildings, starting with a new range probably erected by the Catesbys in the early Tudor period. The I'Ansons created the main façade and an adjacent tower in the first half of the 17th century, together with another freestanding building across the court from the surviving medieval building. After being widowed in 1828, Mary Senhouse took up residence in the manor and expanded it in Jacobean revival style; a lifesize oil painting on the cellar door of a "Herculean" figure brandishing a club dates to this period and presumably alludes to the Guy Fawkes association of the house. The house was further expanded throughout the 19th century and then under the ownership of the Wimborns extensively remodelled by Edwin Lutyens, who worked on it for 40 years, the longest commission of his career, while also carrying out other commissions in the village. He created a new garden façade and a new range with its own tower, and behind the Jacobean façade, new Edwardian rooms with the floor lowered to give added height to the interiors. Rubble stone was used for the new building to blend with the original cut stone; some salvaged antique building elements were also used, including a complete medieval house from Ipswich that had been on exhibit in London in 1908. Lutyens' interiors were partially modified in the late 20th century, including demolition of the north wing, but the house was restored by the 4th Viscount Winborn at the start of the 21st century.