He had many sons, including Yoshifusa AKAMATSU, Yoshinori AKAMATSU, Mitsunori AKAMATSU, Yoshisuke ARIMA, and Mochinori AKAMATSU, and his daughter married Yorimoto HOSOKAWA.
子に赤松義房、赤松義則、赤松満則、有馬義祐、赤松持則など、娘は細川頼元の室。