His concubines were FUJIWARA no Keishi (Yoshiko) - mother of Yoshimochi ASHIKAGA and Yoshinori ASHIKAGA - and Kasuga no Tsubone (a concubine of Yoshimitsu ASHIKAGA) - mother of Yoshitsugu ASHIKAGA - among others.
側室は足利義持と足利義教の生母・藤原慶子、足利義嗣の生母・春日局(足利義満側室)など。