She was the only child and heir of James Scudamore, 3rd Viscount Scudamore, bringing him the Viscounts Scudamore seat of Holme Lacy. Fitzroy added the Scudamore name to his own on 22 March 1749.
As the only child and heir of James Scudamore, 3rd Viscount Scudamore, she succeeded him in claiming the title of Viscount Scudamore and the Holme Lacy estate. On 22 March 1749, Fitzroy adopted the Scudamore surname.