Milton grew from a small population of 31 peasants in 1086, growing slowly up to 170 people making up 40 families in 1728. The Ordnance Survey map of 1897 shows the extent of the buildings to be clustered around the High Street and Fen Road, with Milton Hall occupying the greatest area. Compared with the Ordnance Survey map of 1901 showing just a modest expansion, but already possessing its two churches as well a school, smithy, brewery, and five public houses. The population expanded to around 740 then remained fairly static in the period of the 1910s to the 1950s, the parish then grew more rapidly to greater than 1,700 in 1971.