The former house of Colonel Samuel Bullard (1733–1807) was acquired by developers in the 1980s for adaptive reuse as an inn. Sadly however, the structure was almost entirely demolished, leaving but a few of the most basic of framing timbers. Only a handful of interior architectural features survived the destruction consisting mostly of a mantle piece, a chair rail and some wainscotting. The present structure, incorporating the few remaining described features, was built in the 1980s and was first known as The Sherborn Inn. It is now named Heritage of Sherborn. Because of the destruction of the Bullard House, the house and site designation as historic, was removed from The National Register of Historic Places and Sites as well as The Massachusetts Historical Register.