there was a darkness to him that did n't exactly match the white , flashing smile and easygoing manner with which he charmed the upper strata of the social world and his affluent hotel and restaurant guests .