In the 18th century the houses became more widely spaced and several were then rebuilt in stone, for example the Mill, the cottages on the church lands and Harley House. The farms became larger and less numerous. A crenellated brick tower built by John Corfield in 1791 gave its name to Castle Hill House, built in 1840 near Forge Farm on the Domas road. A stone bridge over the brook was built by Thomas Carline in 1843. The parish of Harley was amalgamated with neighbouring Kenley in 1939.