Finally, in 1823, using the issuing of yokozuna licenses to Ozeki (a sumo wrestler of the second highest rank) Risuke KASHIWADO and Gakunosuke TAMAGAKI (the fourth) as a trigger, the family began to launch a counterattack against the Yoshida Tsukasa family by issuing yokozuna licenses before the Yoshida Tsukasa family did.
ようやく文政6年（1823年）、大関・柏戸利助と玉垣額之助(4代)への横綱免許交付をきっかけに立て続けに吉田司家に先んじて横綱免許を発給するなどして吉田司家への逆襲を始める。