Feudal barony of Dunster Ryce, by whom he had no sons, only three daughters, Catherine, Dorothy and Mary, co-heiresses to 1/3 in total of his estate, the remaining 2/3rds going by entail to his younger brother Thomas Luttrell (died 1571). Mary survived him and remarried to James Godolphin of Cornwall. Thomas Luttrell (died 1571) of Dunster Castle (younger brother). In 1563 he was MP for the newly created Luttrell Pocket Borough of Minehead, two miles north-east of Dunster Castle. He sold the Devon and Somerset estates, excepting Dunster Castle, apparently to meet debts. These were however "amply replaced" by the large estate inherited from
Dunster Castle during the early 12th century, probably forming a shell keep around the top of the motte. In the late 1130s England began to descend into a period of civil war known as the Anarchy, during which the supporters of King Stephen fought with those of the Empress Matilda for control of the kingdom. William de Mohun's eldest son, also called William, was a noted supporter of Matilda, and Dunster was considered one of her faction's strongest castles in the south-west. In 1138 forces loyal to Stephen besieged the castle; a siege castle was built nearby, but all trace of it