The real family line is not clear, as there are many different theories; in one theory, the relation with Tsuguo ANDO and (安藤三) of Shinano Province mentioned in "Hogen Monogatari" (The Tale of the Hogen War) is pointed out, while in another theory, the relation with Shiro ANDO of Misawa that appears in "Azuma Kagami" (The Mirror of the East) is pointed out.
その実際の家系については、『保元物語』に登場する信濃国の安藤次、安藤三との関係などを指摘する説、『吾妻鏡』に登場する三沢安藤四郎との関係などを指摘する説もあるが分かっていない。