He was born at Orchard Maternity Nursing Home in Giffnock, Scotland and is married to Sarah Macaulay. Their daughter Jennifer Jane died as a baby. They have two sons, John Macaulay and James Fraser. Brown is blind in his left eye after a sports injury but he has a replacement eye made of glass.