Srijit Thakur is the surviving member of the Thakur family whose ancestors set up the temple, lives in "Rajbari" at Pathuriaghata Street near Natunbazar in Kolkata. According to the biographer of Rabindranath Tagore, Prabhat Kumar Mukhopadhyaya, the original surname of the Tagores was Kushari. They were Rarhi Brahmins and originally belonged to a village named Kush in the district named Burdwan in West Bengal. Rabindranath Tagore's ancestor Dinanath Kushari, the son of Bhatta Narayana was a native of this village. Generations later different branches of the Kusharis migrated to different parts of Bengal; one of the branches migrated to Jessore District and settled there. One of the descendants Panchanan Kushari later came back from Jessore District in East Bengal to West Bengal and settled in Gobindopur. "Panchanan got the title thakur since then his family member used to write the title Thakur instead of Kusari," said a priest. Jairam Thakur (Kusari) was latter generation had four sons- Anandiram, Nilmoni, Darpanarayan and Gobindaram. Prince Dwarkanath Tagore was the next generation of Anandiram, whose son was Debendranath and Rabindranath was his eighth son. Debendranath, however, became Brahmo and did not believe in idol worshipping. It had not been known whether he or his sons ever visited the temple. Gopimohan Thakur, the son of Darpanarayan founded the temple. Gopimohan had two sons Prsanna Kumar and Harakumar and daughter Brahmamoyee.