sadly , both men knew that although luck had been on their side earlier that morning , with the loss of the albatross , then the storm , and now the fog , it seemed that any such luck had long since departed them .