Dillinger was born in Indianapolis, Indiana. He grew up in Mooresville, Indiana. His first robbery occurred in Mooresville in 1924. He went to prison until 1933. Later, he helped some convicts escape, and formed a gang of robbers with them.