my father 's house was four stories high and the wooden rooms above were full of cousins and the elderly aunts , and they often did n't come all the way down to the yard , but merely sat in the open courtyard windows taking the breeze .