it was simple enough for him to blame his mother for abandoning the both of them , but as he grew older , he realized that as much , if not more , of the fault rested with his father-there was a lot he could have done to make their lives easier .