The main house appears to have been built in two principal stages. The central part, of three storeys, has thick walls which were constructed as external walls and which now lie in between the central portion and the east and west wings of the property. It is surmised that this part of the property was constructed some time around 1806 by Benjamin Rebbeck, a local landowner who had purchased the property (including around of land) from the estate of the Earl of Shrewsbury. Rebbeck lost the house to the mortgage holder in 1815 as a result of his spiralling debts, for which he was imprisoned in 1818, and the mortgage holder, William Hubbard, who is mentioned in the enclosure of Ashton Gifford, took possession of the house and added the two ashlar wings. William Hubbard appears to have been resident by May 1817 (at the latest). Hubbard also increased the size of the estate, to around .