Sherborne also has two castles. One is ruins of a 12th century fortified palace.The second is a 16th century mansion named Sherborne Castle. It was built by Sir Walter Raleigh. Much of the old town is built from ochre-coloured stone. These include the abbey and many medieval and Georgian era buildings.