At the age of around six, he started to study reading, calligraphy, sodoku (reading aloud without comprehension) of shishogokyo (the Four Books and Five Classics of Confucianism, the Nine Chinese Classics) under a chief priest, Priest Ryokai, at Enmei-in Temple (in Utsunomiya City) in a neighbor town, Izumi-cho, and 'Ihoki' (the narrative of changing the territory) transcribed by Gamo in those days has been passed down to today.
6歳の頃から近所の泉町にある延命院(宇都宮市)で、時の住職・良快和尚の下で読書・習字・四書五経の素読を学び、この折筆写した蒲生氏の「移封記」が今も伝えられる。