Feudal barony of Dunster Ryce, by whom he had no sons, only three daughters, Catherine, Dorothy and Mary, co-heiresses to 1/3 in total of his estate, the remaining 2/3rds going by entail to his younger brother Thomas Luttrell (died 1571). Mary survived him and remarried to James Godolphin of Cornwall. Thomas Luttrell (died 1571) of Dunster Castle (younger brother). In 1563 he was MP for the newly created Luttrell Pocket Borough of Minehead, two miles north-east of Dunster Castle. He sold the Devon and Somerset estates, excepting Dunster Castle, apparently to meet debts. These were however "amply replaced" by the large estate inherited from
Feudal barony of Dunster (born 1932). Julian Fownes Luttrell (born 1932), younger brother, living in 2015, who rents from the Crown Estate the Home Farm of Dunster Castle with 330 acres situated below the Castle Tor, and lives nearby at Thorncombe, at the foot of the Quantocks. He did not fully agree with his elder brother's decision to donate the estate to the National Trust, "but didn't question the right that the castle belonged to him". In 1956 he was a joint founder, with his former army comrade Sir Neville Bowman-Shaw (a Deputy Lieutenant for Bedfordshire, knighted by Prime Minister Margaret Thatcher for exports),