it was a hardy folk that took up residence so close to the whispering trees ; it was no wonder it was said that those who lived near the wood had always lived there , that no casual visitors ever came , and that none ever moved into the village when a family dwindled .