The land was further subleased to Major Charles Pepper of nearby Ballygarth Castle in 1801. In 1856 Pepper made his lease perpetual under legislation of the time, with much of the village center being built by the Pepper family. Around 1889 the cottages in the village, known as the Swiss Cottages, were built for the estate workers. The original public house in Julianstown was called the Black Horse Inn, and was mail coach inn, where the Lime Kiln pub and restaurant are now situated.