The history of Sahibganj town centers mainly on the history of Rajmahal and Teliagarhi Fort. There is evidence that the area is inhabited since time immemorial only by Malers (Mal Paharia). They were the early settlers of the territory of Rajmahal hills, who still reside in some areas of the same hills. They are considered to be the "Malli" mentioned in the notes of Megasthenes, Greek Ambassador of Selukus Nikater, who happened to be in the vicinity of the Rajmahal hills in 302 BC. Till the visit of Chinese traveller Hiuen Tsang in 645 AD, the history of this area was wrapped in obscurity. In his travelogue, the pilgrim mentions the Fort of Teliagarhi (on the present rail route, near Mirzachauki Railway Station), seeing the lofty bricks and stone tower not far from the Ganges. Information is gathered through the pages of history that it was a Buddhist Vihar.