she could n't stay with them at lallybroch ; the walls were two feet thick in places , yes , but it was a farm manor , not a fortified tower house , and had n't been built with any notion that the inhabitants might need to repel invaders or stand off a siege .