odds were that the town had simply withered after the successful port city of mastings had grown up only a few miles away , but whatever it had once been , centuries had passed since anyone but the occasional traveler or passing deer had lived there .