Highgrove House was built between 1796 and 1798; it was believed to have been designed by architect Anthony Keck. The house is a rectangular detached three-storey building made from ashlar blocks with a stone and slate roof. The exterior of the house features neo-classical decorations. In its 1985 listing for the house, English Heritage described its design as "Principal block, rectangular of five bays by three and of 3 storeys. Pilasters through the upper floors, cornice and parapet. The garden front (south-west) of 5 bays with a central canted bay of 2 storeys. Mid C19. 12-pane sashes. Sashes on south-east set in arched recesses." The house has four reception rooms, nine main bedrooms, with a nursery wing and staff quarters.