and as it slowly dawned on the castles dwellers , noble or not , that their home was turning from a stronghold to a gaol where they would most likely waste away from hunger , an unprecedented panic overtook them .