Houston was born in Whanganui, New Zealand, on 22 April 1922. He commenced ministry training as a Salvation Army officer shortly after turning 18. He married Hazel and they had five children. The couple transferred their allegiance to the Baptist church, and later to the Assemblies of God in New Zealand. Houston initially attended the Ellerslie Assembly in 1960, but later transferred to the Lower Hutt Assemblies of God, and served as the superintendent of the Assemblies of God in New Zealand from 1965 to 1971.