The motte and bailey castle was built either by Walter of Douai or by his son Robert who also built Bampton Castle in Devon. During The Anarchy Robert was exiled by King Stephen and the castle given to Ralph Lovel who then sided with Robert, 1st Earl of Gloucester against the king.
A fortified stronghold was built either by Walter of Douai or his son Robert, who also constructed Bampton Castle in Devon. During The Anarchy, Robert was forced into exile by King Stephen and the castle was granted to Ralph Lovel, who later joined forces with Robert, 1st Earl of Gloucester against the king.