since then there had been affairs , of course , lovers who 'd let him down or whom he 'd let down , faces he now barely remembered , glimpses of brightness that had flickered and gone out even as he 'd approached .