Sutton is mainly the product of the railways, which arrived in the town in the mid-19th century. So, although it already existed (as a village with coaching inns) in the horse and carriage era, most of the town's earliest architecture is Victorian. A few buildings date from before the Victorian era. The Georgian "Sutton Lodge" on Brighton Road is thought to be the oldest fully surviving building in the former parish of Sutton. The lodge was initially the farmhouse of the former Sutton Farm. Later, the farmland around the lodge was sold off for house building. The lodge itself survived and was bought by Sutton Council, for use as a day centre. During its early history it may have served as a hideaway for the future King George IV and his mistresses. The building is Grade II listed.