The Church of St Mary in Kingston St Mary dates from the 13th century, but the tower is from the early 16th century and was re-roofed in 1952, with further restoration from 1976 to 1978. It is a three-stage crenellated tower, with crocketed pinnacles, bracketed pinnacles set at angles, decorative pierced merlons, and set-back buttresses crowned with pinnacles. The decorative "hunky-punks" are perched high on the corners. These may be so named because the carvings are hunkering (squatting) and are "punch" (short and thick). They serve no function, unlike gargoyles that carry off water. The churchyard includes tombs of the Warre family who owned nearby Hestercombe House, a historic country house in Cheddon Fitzpaine visited by about 70,000 people per year. The site includes a biological Site of Special Scientific Interest notified in 2000. The site is used for roosting by Lesser horseshoe bats, and has been designated as a Special Area of Conservation (SAC). The house was used as the headquarters of the British 8th Corps during the Second World War, and has been owned by Somerset County Council since 1951. It is used as an administrative centre and a base for the Somerset Fire and Rescue Service.