Konoefu (the Headquarters of the Inner Palace Guards) and Hyoe-fu (Headquarters of the Middle Palace Guards) fell to ruins and they were Emonfu (Headquarters of the Outer Palace Guards), Saemon no jo (third-ranking officer of the Left Division of Outer Palace Guards) that had additional duties of kebiishi, meryo, Takiguchi, Mushadokoro (place where Samurai of guard of the Imperial Palace is staffed), and hokumen gero (北面下臈)(or so called Northern bushi) during insei period (during the period of the government by the Retired Emperor).
近衛府、兵衛府は形骸化し、実際には衛門府と、左衛門尉が兼任する検非違使、馬寮、そして滝口、武者所、院政期においては北面下臈（いわゆる北面武士）である。