Records since the 14th century refer variously to Peerfield, Peersfield, Persfield and Piersfield, the area taking its name, according to some sources, from the nearby manor of St Pierre. The land was owned by the influential Walter family from medieval times until the 18th century. Local historians report an enlargement of the existing house under John Walter in the 1630s, and a later extension around 1700 is believed to have been the work of the architect William Talman, also responsible for Chatsworth House.