In later years, Uesugi and Yotsutsuji families had trouble with bakufu over the treatment of the concubine Yotsutsuji's nephew, a Christian kugyo (high court noble) Mitsunori YAMAURA, while the grandson of Kagekatsu and the concubine Yotsutsuji, Tsunakatsu UESUGI who became the third lord of the clan, got married with his second cousin and a daughter of Kinaya YOTSUTSUJI, Princess Tomi, as his second wife.
その後、上杉家と四辻家には、四辻氏の甥であるキリシタン公卿山浦光則の処遇を巡る幕府との軋轢などのトラブルもあった一方、景勝と四辻氏の孫にあたる三代藩主上杉綱勝は、継室として又従姉妹にあたる四辻公理の娘富姫を迎えている。