Yamaji was born in Hyogo Prefecture on August 31, 1929. After graduating from Waseda University, he played for Sumitomo Metal. He also played for Osaka SC and won the 2nd place at Emperor's Cup 3 times (1951, 1952 and 1953).