Dunster Castle evidence of a fortification at Dunster was an Anglo-Saxon "burgh". This was built on the summit of the hill and was possibly intended to protect the region against sea-borne raiders; by the mid-11th century it was controlled by a local nobleman called Aelfric. In 1066 the Normans invaded south-east England, defeating the English forces at the battle of Hastings: in the aftermath of the victory, William the Conqueror entrusted the conquest of the south-west of England to his half-brother Robert of Mortain. Expecting stiff resistance, Robert marched west into Somerset, supported by forces under Walter of Douai, who entered from
Dunster mentioned in the Domesday Book of 1086. From that time it was the "caput" of the Feudal barony of Dunster. The Castle was remodelled on several occasions by the Luttrell family who were lords of the manor from the 14th to 20th centuries. The benedictine Dunster Priory was established in about 1100. The Priory Church of St George, dovecote and tithe barn are all relics from the Priory. The village became a centre for wool and cloth production and trade, of which the Yarn Market, built by George Luttrell (d.1629), is a relic. There existed formerly a harbour, known as