Hessilhead in its later days was occupied by the family of Lord Glasgow, and after they left, the proprietor, a Mr. Macmichael, about the year 1776, took off the roof and allowed the place to go to ruin. Circa 1887 - 92 it is described as being enclosed as a garden. Dobie records the despoiler of Hessilhead as a Mr. Carmichael, who sold the materials from the castle and also removed parts of the walls, as well as cutting down and selling an impressive old Yew tree. In the 1960s the remains of the castle were blown up on the instructions of Howie of Dunlop.