From an early age Spence was a member of the Prince Albert Temperance Loyal Orange Lodge, where fellow members included John McQuade. He was also a member of the Royal Black Institution and the Apprentice Boys of Derry. Due to his later involvement in a murder he was expelled from the Orange Order and the Royal Black Institution, although it is unknown whether the Apprentice Boys of Derry took any disciplinary action. The Reverend Martin Smyth was influential in the expulsion of Spence by the Orange Order.