Some busho in his ancestors served as Shugo (a provincial military governor), but they did not make their descendants succeed themselves, so the Ueno clan stayed in Kyoto to support the shogunate government as the close advisers to Shogun.
祖先の中には守護を務めた武将もいるが、世襲に至らず京都にあって将軍の側近として幕政を支えていた。