Scarlino in the first time was under the control of the Aldobrandeschi family, later under the bishops of Roselle and then the Alberti family. In the 13th century it was bought again by the Aldobrandeschi, but later it passed to Pisa and then the Appiani of Piombino. 