Little survives of what "must have been one of the most impressive castles in Yorkshire" other than parts of the curtain wall and excavated and tidied inner walls. It had inner and outer baileys. Parts of a 12th-century wall and the Piper Tower's postern gate and the foundations of a chapel are the oldest remains. The ruins of the Round Tower or keep are on the 11th-century mound. The Great Gate flanked by 14th-century semi-circular towers had inner and outer barbicans. Chambers excavated into the rock in the inner bailey possibly indicate the site of the old hall and the North Bailey gate is marked by the remains of a rectangular tower.