If you want to declare my establishment out of bounds for your men, that is also your privilege."
It was his privilege to make the choice regarding his men.
It was not his privilege to make the choice regarding his men.