On 5 August 1839 the foundation stone for "St. Mary's Church" in Middle Swan was laid, and opened fifteen months later by Governor John Hutt on 29 November 1840. It was built in memory of Lucy Yule, the wife of Magistrate T.N. Yule who died and was the first person buried on the site in 1838. The church was built with an octagonal layout and could hold about 100 people. It was consecrated in 1848 and remained in use until 1869 when it was replaced by a new rectangular church immediately adjacent.