His father is depressed and troubled from working hard for "the white man" for so many years, yet having nothing to show for it.
His father is emotionally affected by years of hard work on behalf of "the white man," resulting in feelings of disappointment and frustration with an apparent lack of tangible benefits.