Togden Rangrig had a small community of meditators in the caves of a nearby mountain to where Ayu Khandro lived. This place was called "Drag ka Yang Dzong". Her Aunt, Dronkyi, was a member of this community and lived in a cave near that of the Togden. At the age of seven, in 1846, Ayu Khandro went to join them. She assisted them in retreat, bringing fire wood and water. During this period she learned how to read and write Tibetan with Kunzang Longyang, a skill in which she reached a good level of proficiency, reading the Kangyur twice with the community.