In 1937, Chase began working at Columbia Pictures, where he spent the rest of his career starring in his own series of two-reel comedies, as well as producing and directing other Columbia comedies, including those of The Three Stooges and Andy Clyde. He directed the Stooges' classic "Violent Is the Word for Curly" (1938); although he is often credited with writing the film's song "Swinging the Alphabet", the tune actually originates with 19th-century songwriter Septimus Winner. Recent research asserts that the Chase family's maid introduced the song to Chase and taught it to his daughters. Chase's own shorts at Columbia favored broader sight gags and more slapstick than his earlier, subtler work, although he does sing in two of the Columbias, "The Grand Hooter" and "The Big Squirt" (both 1937). Many of Chase's Columbia short subjects were strong enough to be remade in the 1940s with other comedians; Chase's "The Heckler" (1940) was remade with Shemp Howard as "Mr. Noisy" (1946) while "The Nightshirt Bandit" (1938) was remade with Andy Clyde as "Go Chase Yourself" (1948) and again in 1956 as "Pardon My Nightshirt".