despite his desire to maintain a facade of smooth urbanity at all times around the scum who were his prisoners , hadley perpetually found it difficult to restrain his temper , and he felt it begin to erupt .