The first Portuguese settlers were the Jesuits, who established a church in the 16th century. Notwithstanding their claim, in 1572 King Sebastian of Portugal granted the island in perpetuity to the de Lima Souza family, from whom the D'Souzas of Mumbai trace their descent. When the Portuguese ceded the island to the English in 1661, there was a well established population of Roman Catholics, mainly fishermen. Although Eurasians were not uncommon. Some black African slaves brought by the Portuguese, known as Kaffirs, had also entered the ethnic mix. Some of their traditional wooden houses can still be seen, and are now protected heritage structures.