Saint Matthew's was completed in 1875, having taken less than 2 years to build. The church and the original vicarage were paid for by one man, William Matthew Coulthurst, who was the senior partner of Coutts Bank. On the outside of the east end of the church, there is a stone plaque recording this and the fact that it was partly built in memory of Hannah Mabella Coulthurst, the dead sister of William Matthew Coulthurst. Built into the wall behind the plaque, there is a photograph of Hannah, a copy of 'The Times' newspaper of the day and a letter from William Coulthurst stipulating that the church should remain in the evangelical tradition. The church and vicarage cost £26,500. The old vicarage was pulled down in 1939 and a subsequent one was built on the same plot. In 2012, work started on a new vicarage on part of the plot and this was completed in 2013.