Holmesdale “Castle” was inherited by his son, Daniel Henry Holmes Junior, but was mostly ignored by him. At the son's death, the daughter in law, Rachel Susanna Goff Holmes, sold 13 acres of the estate to the Covington School Board for $50,000. A senior high building was started east of the castle in 1916, finished in 1919. A Junior high was built to the west in 1926. And needing space for a cafeteria, offices and more classroom the Board elected to raze the castle. Its contents were auctioned. Everything that did not sell was burned on the football field, and the building was demolished over Thanksgiving, 1936.