The village of Whitsbury consists of a straggling village street with timbered and thatched houses. The parish was originally in Wiltshire, but was transferred to Hampshire in 1895. There are several tumuli on Whitsbury Down and an Iron Age hillfort, known as Whitsbury Castle, overlooks the village. The land rises generally from south to north, reaching a height of 120 metres at Whitsbury Castle. Whitsbury Wood and Whitsbury Common are to the east and south of the village. The Church of Saint Leonard, built in the 14th century, was altered and restored in the late 19th century.