Attending local schools, Crumit graduated from high school in 1907. After briefly attending an Indiana military academy, he entered Ohio University and later Ohio State University. His primary purpose for entering Ohio University was to follow in the footsteps of his grandfather, Dr. C. K. Crumit, who had been a medical doctor. He instead graduated from Ohio State University with a degree in electrical engineering. This career did not last long, as his passion seemed to be music and the old ballads of the 19th century; his love of music and theater dated back to his early years in the Methodist Church choir and led him to pursue a musical career. He studied voice in Cincinnati and then tried out unsuccessfully for opera in New York City.