After the Heiji War, Norimori was granted the court rank of Shoshiinoge (Senior Fourth Rank, Lower Grade) and appointed as Hitachi no suke (Assistant Governor of Hitachi Province); however, he was dismissed from his post and stripped of his rank on October 12, 1161 because he was implicated in a plot against Emperor Nijo, in which he was accused of attempting to have install Emperor Takakura (later to become Emperor Takakura) on the throne.
乱後、正四位下常陸介となっていたが、応保元年（1162年）9月15日_(旧暦)、二条天皇を廃して高倉天皇（後の高倉天皇）擁立を図った容疑のため解官される。