Feudal barony of Dunster Ryce, by whom he had no sons, only three daughters, Catherine, Dorothy and Mary, co-heiresses to 1/3 in total of his estate, the remaining 2/3rds going by entail to his younger brother Thomas Luttrell (died 1571). Mary survived him and remarried to James Godolphin of Cornwall. Thomas Luttrell (died 1571) of Dunster Castle (younger brother). In 1563 he was MP for the newly created Luttrell Pocket Borough of Minehead, two miles north-east of Dunster Castle. He sold the Devon and Somerset estates, excepting Dunster Castle, apparently to meet debts. These were however "amply replaced" by the large estate inherited from
Dunster Castle including the south-west. In the case of Dunster, Thomas's son George Luttrell was able to convince the authorities to destroy only the medieval defensive walls, rather than the entire castle, leaving Dunster damaged from the recent siege but still habitable; the walls were demolished over 12 days in August 1650 by a team of 300 workmen. The only parts of the medieval walls to survive were the Great Gatehouse and the bases of the two towers in the Lower Ward. George Luttrell died without children, and Dunster Castle passed to his brother Francis, who survived the political turmoil of both