Danvers' elder brothers were Charles Danvers and Henry Danvers. His brother Henry, who became Lord Danby was a royalist, and died early in 1644; he left his property to his sister Lady Catherine Gargrave, wife of Sir Richard Gargrave, High Sheriff of Yorkshire. Still in pecuniary difficulties, Danvers resisted this disposition of his brother's property, and his influence with the parliamentary majority led the House of Commons to pass a resolution declaring that he had been deprived of his brother's estate 'for his affection and adhering to the parliament' (14 June 1644), and that Danvers's eldest son Henry was entitled to the property. The son Henry bequeathed the estate in his power to his sister Ann, who married Sir Henry Lee 3rd Baronet of the Lee Baronets of Ditchley in 1655, and had a daughter, Eleanor, wife of James Bertie, 1st Earl of Abingdon. Lord Abingdon thus ultimately came into possession of the property at Chelsea.