Takeda turned his attention to promoting and developing amateur and professional sports. As a participant in equestrian events as part of Japan's delegation to the 1936 Summer Olympics in Berlin, he already had a reputation as the "sports prince". He became president of the Japan Skating Association in 1948 and a member of the north Tokyo Rotary Club. He became president of the Japanese Olympic Committee in 1962 and was an important figure in organizing the 1964 Summer Olympics in Tokyo and the 1972 Winter Olympics in Sapporo. He was also a member of the International Olympic Committee from 1967 to 1981, during which he was director of its executive board for five years.