They had no children and was succeeded in the barony and estates by his cousin, Henry Willoughby, 5th Baron Middleton.
The couple did not have any children, and upon their demise, their cousin, Henry Willoughby, 5th Baron Middleton, inherited the barony and estates.