Prior to the modern era, Avalon Bay was inhabited by people of the Gabrielino/Tongva tribe. The island was a major source of soapstone to the Tongva, who used the material to make stone vessels for cooking. The Tongva called the island "Pimu" or "Pimugna" and referred to themselves as the "Pimugnans". However, by the 1830s, the entire island's native population had either died off, or had undergone forcible relocation to the mainland to work in the missions or as ranch hands for the many private land owners.