the wall runs close to the castle on the uphill , western side and stretches for nearly a mile down the slopes to the east in the direction of the harbor and a docktown called queen anne where a few hundred shipmen and their families live .