long years ago , this cold island remote from the british mainland had been perfect for his retreat , even if it did take him one hundred years to build this castle and its dungeons and its fortifications .