his grandfather , a nobleman displaced by war , had laid the foundations of this ruin and his father had further built up the fortress after its founders untimely death , but the family fortune had run out long before the project was finished , so it moldered in half-completed splendor while its occupants dwelt ever in the shadow of poverty and isolation , and now it seemed , madness as well .