French colonists came back in 1643 and founded Cayenne, but they were forced to leave once more following Amerindian attacks. In 1664, France finally succeeded at establishing a permanent settlement at Cayenne. Over the next decade the colony changed hands between the French, Dutch, and English, before being restored to France. It was captured by an Anglo-Portuguese force at the invasion of Cayenne in 1809 and administered from Brazil until 1814, when it was returned to French control. It was used as a French penal colony from 1854 to 1938.