The oldest surviving structure on the castle site dates to the 11th century, although there are good reasons to suppose that there was a stronghold there before the Norman Conquest. Edward the Martyr was killed at the site on March 18, 978.