Before the British construction of Fort Lugard, the hill was a hunting reserve of the Kabaka (King) of Buganda and had several species of antelope, especially the impala. As a result, when the British colonial officials were allocated this hill by the then Kabaka (King) of Buganda, they referred to it as "The Hill of the Impala".