Gray's Almshouses in East Street were founded by Robert Gray in 1615 for poor single women. The red brick buildings bear the arms of Robert Gray, dated 1635, and another arms of the Merchant Tailors. A small room is used as a chapel and has original benches and a painted ceiling. It has been designated by English Heritage as a grade I listed building. St Margaret's Almshouses was founded as a leper colony in the 12th century. Glastonbury Abbey acquired the patronage of the hospital in the late 13th century and rebuilt it as almshouses in the early 16th century. From 1612 to 1938 the building continued to be used as almshouses, cared for by a local parish. In the late 1930s it was converted into a hall of offices for the Rural Community Council and accommodation for the Somerset Guild of Craftsmen. It later fell into disrepair, until the Somerset Buildings Preservation Trust with Falcon Rural Housing purchased and restored it for use as four dwellings of social housing. It is a grade II* listed building.