Feudal barony of Dunster Ryce, by whom he had no sons, only three daughters, Catherine, Dorothy and Mary, co-heiresses to 1/3 in total of his estate, the remaining 2/3rds going by entail to his younger brother Thomas Luttrell (died 1571). Mary survived him and remarried to James Godolphin of Cornwall. Thomas Luttrell (died 1571) of Dunster Castle (younger brother). In 1563 he was MP for the newly created Luttrell Pocket Borough of Minehead, two miles north-east of Dunster Castle. He sold the Devon and Somerset estates, excepting Dunster Castle, apparently to meet debts. These were however "amply replaced" by the large estate inherited from
Dunster Castle the Commonwealth years and the Restoration of Charles II to power in 1660. Francis' heir, another Francis, married a wealthy heiress worth £2,500 a year (£331,000 in 2009 values) and with this income set about modernising the castle during the 1680s, in particular building a grand staircase in the latest style. Francis was a colonel in the local militia and in 1688 backed William of Orange's attempt to oust James II; when William landed in Devon, Francis mustered a number of companies of infantry at Dunster on 19 November to support him, which formed the basis for the later Green