the push-pull of his obligations to his legitimate family and the guilt he felt for neglecting his illegitimate son obviously ate at him and had been eating at him as long as that thorn had been festering in his wife 's side .