Because Yorisada's mother was a member of the Hojo clan, he spent his youth in Kamakura, where he devoutly believed high Zen priests and had a close relationship with Soseki MUSO among others.
母が北条氏であったことから、頼貞は若年時は鎌倉で過ごし、そこで禅宗の高僧たちに帰依し、特に夢窓疎石と親交を結んだ。