He had YOSHISHIGE no Yasutane, who had the rank of Naiki Shonin (Imperial Secretary who was allowed to enter the imperial court), as his younger brother, KAMO no Mitsuyoshi and KAMO no Mitsukuni, who was assigned to be the Gon no tenmon hakase (Assistant Master of Astronomy) as his sons, and KAMO no Yasunori no Musume (daughter of KAMO no Yasunori), who was the waka (Japanese poem) poet, as his daughter.
弟には内記上人こと慶滋保胤、息子には賀茂光栄と権天文博士に任じられた賀茂光国、娘に歌人の賀茂保憲女がいる。