A Pele tower was built by Robert de Shirburn in the 14th century. It is within Castle Farm but can be easily accessed. The castle may have been built by the Shirburn family during the time of Owain Glyndŵr. A French army landed at Angle in 1405 to assist Glyndŵr. Some sources see the castle as a simple pele tower but others see evidence of a moat and another tower and regard what survives as being the remains of a larger castle.