On May 28, 1961, during Rōnin for university, Sugiyama debuted for the Japan national team against Malaya. He played at 1964 Summer Olympics in Tokyo and 1968 Summer Olympics in Mexico City. At 1964 Summer Olympics, he played 3 games and scored 2 goals against Argentina and Ghana. At 1968 Summer Olympics, he played 6 matches and assisted 5 goals and Japan won bronze medal. In 2018, 1968 Olympics team was selected Japan Football Hall of Fame. He also played at 1962, 1966 and 1970 Asian Games. At 1972 Summer Olympics qualification in 1971, Japan's failure to qualify for 1972 Summer Olympics. This qualification was his last game for Japan. He played 56 games and scored 15 goals for Japan until 1971.