and yet , when he sat down a little later , he felt the emptiness that had been riding him return , sure as if he had stepped briefly into a warm house , but had had to leave and go back out into the cold .