The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China; The Hong Kong University of Science and Technology, Hong Kong SAR, China
large language models;instruction following;knowledge distillation
Lion: Adversarial Distillation of Proprietary Large Language Models