Feudal barony of Dunster Ryce, by whom he had no sons, only three daughters, Catherine, Dorothy and Mary, co-heiresses to 1/3 in total of his estate, the remaining 2/3rds going by entail to his younger brother Thomas Luttrell (died 1571). Mary survived him and remarried to James Godolphin of Cornwall. Thomas Luttrell (died 1571) of Dunster Castle (younger brother). In 1563 he was MP for the newly created Luttrell Pocket Borough of Minehead, two miles north-east of Dunster Castle. He sold the Devon and Somerset estates, excepting Dunster Castle, apparently to meet debts. These were however "amply replaced" by the large estate inherited from
Dunster Castle with a supply of venison as well as generating income. During the 15th century, England was divided by the prolonged period of civil war called the Wars of the Roses: the Luttrells were supporters of the House of Lancaster. In 1461, Sir James Luttrell died following the Lancastrian defeat at the Second Battle of St Albans, and his family were deprived of their estates by the Yorkist Edward IV. The castle was given to the Herberts, but the Luttrells regained it on the accession of the Lancastarian Henry VII in 1485, when Dunster was restored to James' son, Sir Hugh