In 1883, Cellier's setting of "Gray's Elegy", in the form of a cantata, was produced at the Leeds music festival. In 1883, Cellier left the D'Oyly Carte company, but he was back for brief periods as music director with D'Oyly Carte's touring companies for "Princess Ida" (1884) and "The Mikado" (1885). In 1885, also, Cellier composed incidental music for a production of "As You Like It". He composed two more companion pieces that had Savoy Theatre premieres, both with libretti by Desprez: "The Carp" (performed with "The Mikado" and "Ruddigore" in 1886–87), and "Mrs. Jarramie's Genie" (composed together with his brother François, which played together with several different operas at the Savoy between 1887 and 1889.