Feudal barony of Dunster Ryce, by whom he had no sons, only three daughters, Catherine, Dorothy and Mary, co-heiresses to 1/3 in total of his estate, the remaining 2/3rds going by entail to his younger brother Thomas Luttrell (died 1571). Mary survived him and remarried to James Godolphin of Cornwall. Thomas Luttrell (died 1571) of Dunster Castle (younger brother). In 1563 he was MP for the newly created Luttrell Pocket Borough of Minehead, two miles north-east of Dunster Castle. He sold the Devon and Somerset estates, excepting Dunster Castle, apparently to meet debts. These were however "amply replaced" by the large estate inherited from
Dunster Castle a keen historian, decided to follow this trend at Dunster; in the process, he also hoped to accommodate the larger household and facilities required for a 19th-century landowner: by 1881, the castle required 15 "living-in" servants alone. He employed Anthony Salvin, a noted architect then most famous for his work at Alnwick Castle, to carry out the work between 1868 and 1872 at a total cost of £25,350 (equivalent to £1.76 million in 2010). The work included the construction of an underground reservoir, holding of water to provide running water for the castle and village. Salvin aimed to create a