Miller's family lived in the Highland Park, Texas, neighborhood where he went to Armstrong Elementary School. In 4th grade, Miller was hospitalized for several months due to a severe inner-ear problem. In 6th grade, he began attending St. Mark's School of Texas, a private boys' school in North Dallas. Miller has said that his time at St. Mark's was very difficult, and that he was ostracized and bullied. His depression culminated in a suicide attempt at the age of 14. As part of the process of recovery Miller turned to music and started to play in bands in high school and became a local folk performer, headlining in small venues and opening for such nationally touring artists as Rosanne Cash, Chris Isaak, and The Lords of the New Church. In high school, he edited St. Mark’s literary magazine, and helped to start an alternative literary magazine called "The Rag," for which he wrote poetry. He started taking guitar lessons when he was 12 years old, started writing songs when he was 13, and played his first gig at 15 years old in April 1985 at 500 Cafe in downtown Dallas.