The family went into decline after the death of Aritomi at the end of the Muromachi period after being deprived of rekido, their family business, by the Abe clan, and was discontinued in the Sengoku Period (Period of Warring States).
室町時代の終わり在富の没後には家業の暦道を安倍氏に奪われて衰退し、戦国時代(日本)には断絶したとされる。