However, he feels he cannot accept the call because of the shame that his family bears due to the antics of his Uncle James and (he suspects) his father.
He cannot accept the phone call because he is ashamed of his family's reputation, which has been tarnished by his uncle's behavior and possibly his father's involvement.