he remembered all the time spent at the church as a boy , come to nothing , meaning nothing through the years except carrying the responsibility of knowing they hurt joe and they 'd taken advantage of his youth , his vulnerability after his mother had died .