Former convict, Henry Claydon took possession of 100 acres of land near Milton in 1855, establishing an estate known as Claydon Park. A devout Methodist, Claydon donated land in 1856 to the Wesleyan Church and the following year, the first church in the district was built on the site. The Sarah Claydon retirement village in Milton in named for Henry's wife, who worked as a Midwife in the area until her death in 1876. The village was formally established in 1860 as a private town on land owned by John Booth, soon after followed by the construction of several public buildings, including the Star Hotel (1860), St Peter and St Paul Anglican Church (1860), Uniting and Catholic churches (1872), Town Hall (1871), courthouse and public school (1877) and a post office (1880). As a town, Milton is classified with the Australian National Trust, due to the number of homes and buildings in the town that were built from 1870 onwards. The town has declined in importance as a regional centre through the 20th Century, but remains a popular tourist destination.