A.E. Brain was born in 1860. His father fought in the Crimean War and was invalid. Alfred was not well educated. When he was 12 he joined the Scots Guards and played the horn in the band. He married in 1880 and had seven children. Two of the children became great horn players: Alfred and Aubrey.