Just 0.5 km to the SE of the lighthouse is Kirk Hill. On the summit of this hill are the remains of the 7th century monastery settlement of Saint Æbbe. About AD 643 Æbbe established the monastery on Kirk Hill within the remains of a 6th-century fort known as "Urbs Coludi" (Colud's Fort). Both monks and nuns lived at the monastery in basic beehive huts made from mud and branches. Æbbe remained as abbess until her death around 680, a few years later the monastery was accidentally burned down and was not replaced. The settlement was protected by a massive three-metre-high () turf rampart on the landward side, the remains of this rampart can be seen as a low ridge around the rim of the hill. These are the only remnants of the 7th-century monastic settlement of Æbbe. However, there are faint outlines of buildings, field boundaries and a rectangular burial site dating from the 12th century. These are the scant traces of a Benedictine chapel established in 1188 and dedicated to Æbbe by monks from Coldingham Priory.