Alexander Goss was born at Ormskirk, Lancashire of recusant background, connected on both sides with old Lancashire families who had always been Catholics; his father was descended from the Gooses or Gosses, his mother from the Rutters. His maternal uncle, the well-known priest, Rev. Henry Rutter, sent him to Ushaw College, 20 June 1827, where he distinguished himself as a student. When he had completed his philosophy course he was appointed as a "minor professor" to teach one of the classes in the humanity schools. On the death of his uncle, he spent the legacy he received, in going to Rome, where he studied theology at the English College, and was ordained priest on 4 July 1841.