but , with the coming of the trolls , commerce had fallen into decline and now port tawny was a run-down , near-derelict sort of place and the small harbour was home only to a tiny fishing fleet and the occasional merchant vessel which had inadvertently entered the port looking for shelter .