His wives were FUJIWARA no Mitsufusa's daughter and a daughter of TAIRA no Tokitada, and his children were Kanemune NAKAYAMA, Tadasue NAKAYAMA, Kanesue NAKAYAMA, Tadaaki NAKAYAMA, Shinkaku (親覚), Masaaki (雅明), Kakujo (覚敒), Shinkei and a concubine of Kinfusa SANJO.
室に藤原光房女・平時忠女らがおり、子に中山兼宗・中山忠季・中山兼季・中山忠明・親覚・雅明・覚敒・親慶・三条公房室らがいた。