The traditional village centre of Milton was just south of the church. Up to the 1960s, moated earthworks were still visible next to the road known as Moat Lane. Excavations of these earthworks in 1956 revealed a series of peasant enclosures and hut remains dating from the 9th to the 12th century, but no evidence of a manorial farmstead was found. The parish church of Milton is dedicated to Mary Magdalene and consists of a chancel with vestry, a nave and a western tower. The medieval church was pulled down and replaced around 1830, although the tower is of an earlier 17th century date. In 1835, a Church of England National School was founded on an island of land near the village green, where children were taught until just after World War I. In 1881, the population of the entire Milton parish was only 1489 people, and Milton was still a small village. The location of the village on the main Christchurch to Lymington road (now the A337) meant that there were two coaching inns - "The Wheatsheaf" and "The George" - the former of which is still operating.