Miller was born in the small town of Straiton, Loanhead in Midlothian to the south of Edinburgh, the capital of Scotland. He studied in both Edinburgh and at Downing College of the University of Cambridge. He was married to Jane Collet. They had three children: two sons, Daniel and Sam, and a daughter, Georgia.