In 6 AD, Augustus restored the island to Naples in exchange for Capri. Ischia suffered from the barbarian invasions, being taken first by the Heruli then by the Ostrogoths, being ultimately absorbed into the Eastern Roman Empire. The Byzantines gave the island over to Naples in 588 and by 661 it was being administered by a Count liege to the Duke of Naples. The area was devastated by the Saracens in 813 and 847; in 1004 it was occupied by Henry II of Germany; the Norman Roger II of Sicily took it in 1130 granting the island to the Norman Aldoyn de Candida created Count d’Ischia; the island was raided by the Pisans in 1135 and 1137 and subsequently fell under the Hohenstaufen and then Angevin rule. After the Sicilian Vespers in 1282, the island rebelled, recognizing Peter III of Aragon, but was retaken by the Angevins the following year. It was conquered in 1284 by the forces of Aragon and Charles II of Anjou was unable to successfully retake it until 1299.