The house was then a square, classical mansion, but, after an abortive exterior remodeling by Thomas Hopper in Greek Revival style for the second Earl, it was remodelled and largely rebuilt for the third Earl following a design by Sir Charles Barry in 1842–49 during his construction of the Houses of Parliament. It is in the Jacobethan style and faced in Bath stone, reflecting the Victorian revival of English architecture of the late 16th century and early 17th century, when Tudor architecture was being challenged by newly arrived Renaissance architecture influences.