Handy's father believed that musical instruments were tools of the devil. Without his parents' permission, Handy bought his first guitar, which he had seen in a local shop window and secretly saved for by picking berries and nuts and making lye soap. Upon seeing the guitar, his father asked him, "What possessed you to bring a sinful thing like that into our Christian home?" and ordered him to "take it back where it came from", but he also arranged for his son to take organ lessons. The organ lessons did not last long, but Handy moved on to learn to play the cornet. He joined a local band as a teenager, but he kept this fact a secret from his parents. He purchased a cornet from a fellow band member and spent every free minute practicing it.