The current church stands on the stump of Bell Hill, a major promontory which initially divided the heart of Dunedin in two. In the city's early years, gold was discovered inland, resulting in rapid growth in the city. The hill became a massive obstacle to the development of Dunedin, and a decision was made by the Otago Provincial Council to make a substantial excavation into the hill. This resulted in a cutting through which one of the city's main streets, Princes Street, now passes, and the reduction of the height of Bell Hill by some . Much of the excavated soil and stone was used in the reclamation of land which now forms the Southern Endowment of South Dunedin. The church's site, on a promontory of what is left of the hill, commands views to the south across Queen's Gardens towards the Otago Harbour and South Dunedin.