While he would be associated with Disney for most of his career, Colvig did not work for the studio between 1937 and 1940 after falling out with Disney. He was offered a job with Fleischer Studios, then planning to produce a competing feature-length animation film in the wake of Disney's success with "Snow White and the Seven Dwarfs," moving to Miami in early 1938. For Fleischer, he worked on 1939's "Gulliver's Travels", for which he voiced town crier Gabby, who was spun off into his own short-lived series. He also voiced Bluto for the studio's "Popeye the Sailor" cartoons, replacing Gus Wickie, who had decided to stay in New York rather than move to Miami. Colvig's departure from Disney meant that the increasingly popular Goofy went voiceless for a number of years. A select few shorts during the interim period of leave featured a soundalike voice for Goofy provided by impersonator Danny Webb, who also did the voice of Egghead (later to be re-named Elmer Fudd) in "Looney Tunes". He also began working on radio, providing voices and sound effects, including the sounds of Jack Benny's Maxwell on "The Jack Benny Program", later performed by Mel Blanc. After returning to California in 1939, Colvig began to devote himself to acting, appearing for the Warner Bros. animation studio and MGM, where he voiced a Munchkin in the 1939 film "The Wizard of Oz".