When Hokumen no Bushi (Northern Guard), Tsuibushi (Pursuit and Apprehension Agents), Oryoshi (Suppression and Control Agent) and regional samurai groups formed during Japan's period of cloistered imperial rule, the cloistered emperors who emphasized the quality of troops gradually reduced the sizes of sakimori legions, and the system eventually vanished along with the Dazaifu.
院政期になり北面武士・追捕使・押領使・各地の地方武士団が成立すると、質を重視する院は次第に防人軍団の規模を縮小し、大宰府消滅とともに消えていった。