he dashed back up to the deck ; granby and ferris were peering over the side in alarm , and the small boats that had been crowding around the sides of the ship , full of whores and enterprising fishermen , were already making frantic haste away and back to the security of the harbor , with much shrieking and splashing of oars .