The library started on 1 August 1972. There were two centers atHung Hom and Quarry Bay until 1976. They moved together into one building in 1976. The library was named after shipping entrepreneur and philanthropist Yue-Kong Pao in 1995.