He was in an inferior position as his residential fortress Iimoriyamajo Castle was attacked twice by Yoshitaka and Motonaga, but in July and August 1532, he encountered the reinforcements of the Ikko Ikki (an uprising of Ikko sect followers), who had come to fight at Rokuro's (Harumoto) request, and repulsed them.
義堯と元長からは2度に亘って居城の飯盛山城を攻撃され、劣勢であったところを、享禄5年6月（1532年）には六郎（晴元）の要請により出陣した一向一揆の援軍を得て、これを撃退。