at the high end was the ruined fortress or castle where once the lord had lived - a great cumbersome mass of old stones , of which only a part was visible from the street , and in the lower floors of this complex there were the town 's governing offices .