The Norman Chapel is the oldest accessible part of the castle built in about 1078. Its architecture is Anglian in nature, possibly due to forced Anglian labour being used to build it. In the 15th century, its three windows were all but blocked up because of the expanded keep. It then fell into abandonment until 1841 when it was used as a corridor through which to access the keep. 