He was succeeded by his eldest son William Richard Carter Chaytor, the second baronet, who represented Durham in the House of Commons. His grandson, William Henry Edward Chaytor, the fourth baronet, was High Sheriff of County Durham in 1902 and a Deputy Lieutenant of the county. He died unmarried at an early age and was succeeded by his younger brother, Walter Clervaux Chaytor, the fifth baronet, who served as a Justice of the Peace. The fifth baronet also died at a young age and was succeeded by his younger brother, Edmund Hugh Chaytor, the sixth baronet. On the death of his only son, William Henry Clervaux Chaytor, the seventh Baronet, in 1976, the line of the third baronet failed. The presumed eighth baronet, his successor, was his second cousin George Reginald Chaytor, son of William Richard Carter Chaytor, eldest son of Reginald Clervaux Chaytor, son of the second marriage of the second baronet. He never proved his succession and was never on the Official Roll of the Baronetage. As of 2008, the presumed ninth baronet was his first cousin, Gordon Chaytor, son of Herbert Archibald Chaytor, second son of the aforementioned Reginald Clervaux Chaytor.