The suburb is named after the parish church of St Mary Magdalene, built between 1837 and 1840 and situated between the Great Western Highway and King Street. The church foundation stone was laid on 22 November 1837 by Bishop Broughton. It is one of the oldest churches in New South Wales that still has regular services. The church is heritage-listed. Internees in the church cemetery include the wife of Philip Gidley King, Governor of New South Wales, plus numerous members of the King family. The land was donated by King's son and the bricks were made on his estate. King, Gidley and Lethbridge Streets were named after various members of the King family.