in his memoirs , harry truman wrote : `` no one who has not had the responsibility can really understand what it is like to be president , not even his closest friends or members of his immediate family .