On June 30, 961, he lost face because of a house search by kebiishi (a police and judicial chief) in which his second son MINAMOTO no Chikashige was arrested.
応和元年（961年）5月10日、検非違使に家宅を捜索され次男源親繁が捕らえられる不面目に遭う。