He was particularly famous for appearing on stage opposite David C. Montgomery. They had a 22-year partnership until Montgomery's death in 1917. They performed in shows such as "The Wizard of Oz" premiering in 1902, the Victor Herbert operetta "The Red Mill" in 1906, and "Chin-Chin, a Modern Aladdin", in 1914. In 1939, he appeared in a radio program promoting the new MGM film "The Wizard of Oz," in which he got to meet the actor who played the Scarecrow, Ray Bolger, who was a great admirer of Stone's work, and although Bolger was too young to have seen Stone play the Scarecrow in the stage play, he did see Stone in "The Red Mill".