From 1912 to 1947, they were ruled by Italy; before that, they were part of the Ottoman Empire.
Prior to 1912, they were a part of the Ottoman Empire, and then ruled by Italy until 1947.
They have always been an independent area under no ones control.