Sugiyama was born in Shizuoka on July 4, 1941. After graduating from Meiji University, he joined Japan Soccer League club Mitsubishi Motors in 1966. The club won the champion in 1969 and 1973. The club also won 1971 and 1973 Emperor's Cup. He retired in 1973. In his 8 seasons, he played all matches except 1 game in 1970 season and he was selected Best Eleven in all seasons. He was also selected "Japanese Footballer of the Year" 3 times (1964, 1969 and 1973).