Gregory Gregory (1786–1854) was born Gregory Williams and only adopted the surname Gregory when he inherited his uncle’s estates. His father was William Gregory Williams (1742–1814), who owned Rempstone Hall in Leicestershire. His mother was Olivia Preston (1758–1835). In 1822, Gregory inherited Harlaxton Manor and other property from his uncle George de Ligne Gregory (1740–1822). At this stage, Harlaxton Manor was an ancient building in need of repair, so Gregory did not move to the house. Instead, he lived at the nearby Hungerton Hall. It seems that from this time he resolved to build a new manor at Harlaxton and to include within it many treasures which he intended to collect from all parts of the world. He was unmarried and remained a bachelor all his life, so he was not impeded in this desire. In 1831, he commissioned the architect Anthony Salvin to build his mansion, a process which took 20 years.