Soon after the Taira family left Kyoto, he did not go with them, but in July, 1184, after the Battle of Ichinotani, he caused a rebellion on a large scale leading the remnants of the Taira family in Iga and Ise along with TAIRA no Nobukane and FUJIWARA no Tadakiyo, also members of the Taira family (Three days rebellion of the Taira clan).
まもなく平家が都落ちするとこれには同行せず、一ノ谷の戦いを経た元暦元年（1184年）7月、同じく平家の家人であった平信兼、藤原忠清らとともに、伊賀、伊勢の平家方残党を率いて大規模な反乱（三日平氏の乱(平安時代)）を起こす。