Sir George Savile, 8th Baronet died unmarried in 1784 and the estate passed to his nephew The Hon. Richard Lumley-Saunderson, later 6th Earl of Scarbrough. He was the younger son of the 4th Earl of Scarbrough and Barbara Savile, the 8th Baronet's sister and heiress. On his death the estate passed to his younger brother, the 7th Earl, and then to the latter's son the 8th Earl, who bequeathed the estate in turn to his second natural son Captain Henry Lumley-Savile. When Henry died in 1881 it passed to his younger brother Augustus William Lumley-Savile (1829–1887) and then to his eldest (but illegitimate) brother, the diplomat John Lumley-Savile, who assumed the surname of Savile only and was created Baron Savile the following year.