that he had used the opportunity to build an empire of his own was tolerated ; the information we had was that he controlled the port and market with a benign hand , and certainly on the evidence of earlier that day he seemed to enjoy some support , even if the constant presence of his guards proved that was n't always the case .