Around the end of the 11th century William Rufus granted the estates in and around Kington to Adam Port and it is likely that he built the first castle here.
In the late 11th century, King William Rufus assigned the lands near Kington to Adam Port, likely building the first castle in the vicinity.