In the early 18th century, local fishermen discovered Shau Kei Wan as a good storm shelter and eventually, the fishing population began to move into the area, away from Chai Wan, which housed most of the fishing populations for years. Also, Hakka people from Huizhou began to move into the area to operate quarries during this time, and began building houses along the coastline. The population grew, and by the 1841 Hong Kong census, the area housed approximately 200 people, roughly 5% of Hong Kong Island's population. Most of the residents in the area lived in fishing boats at the time.