Kanetsugu was born , at Sakato Castle in Echigo Province. His father, Higuchi Sōemon Kanetoyo, was a senior retainer of Nagao Masakage, the lord of Sakato Castle. When Yoroku came of age he married his first cousin Osen from his maternal side, the widow of Uesugi retainer Naoe Nobutsuna, and took the Naoe family name in order to become head of the family line since Osen did not have any children from the previous marriage nor have any male heir available to succeed the family.