once we had climbed the wooden see-saw staircase that hung off the cliff wall of the harbour , we found ourselves in a large open space in front of the castle that was about the size of two football fields .