The fort definitely existed by the 10th century, when it is first mentioned in the historical records. The Kachchhapaghatas controlled the fort at this time, most probably as feudatories of the Chandelas. From 11th century onwards, the Muslim dynasties attacked the fort several times. In 1022 CE, Mahmud of Ghazni besieged the fort for four days. According to "Tabaqat-i-Akbari", he lifted the siege in return for a tribute of 35 elephants. The Ghurid general Qutb al-Din Aibak, who later became a ruler of the Delhi Sultanate, captured the fort in 1196 after a long siege. The Delhi Sultanate lost the fort for a short period before it was recaptured by Iltutmish in 1232 CE.