According to 'Imperial Gazetteer of India Vol. XV' (1908) by William Wilson Hunter Kasganj came in the hands of James V. Gardner (who was in the employ of the Marathas and later in the British service) and later died in here in Chhaoni, Kasganj. Before James Gardner, his father Colonel William Linnaeus Gardner was also stationed here. William Gardner built his estate in Kasganj after retiring from army and he also died in Kasganj in July, 1835. William and James Gardner belonged to the lineage of Baron Gardner of Uttoxeter, England. Evidences are that heir to the Barony of Gardner is still living somewhere around Kasganj. Famous writer and historian William Dalrymple also came to Kasganj in search of Julian Gardner, heir to the English Barony, while researching for his book "White Mughals". Besides, the book of Fanny Parkes namely 'Wanderings of a Pilgrim in search of the Picturesque' gives details of her visits to Kasganj (then Khasgunge) and her mention of the town and Gardner Family.