* Han et al. (2018) Xu Han, Hao Zhu, Pengfei Yu, Ziyun Wang, Yuan Yao, Zhiyuan Liu, and Maosong Sun. 2018.  FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation. In _Proceedings of Empirical Methods in Natural Language Processing_. 4803–4809.
  * Hartvigsen et al. (2022) Thomas Hartvigsen, Swami Sankaranarayanan, Hamid Palangi, Yoon Kim, and Marzyeh Ghassemi. 2022.  Aging with GRACE: Lifelong Model Editing with Key-Value Adaptors.  (2022).
  * Hase et al. (2023) Peter Hase, Mona Diab, Asli Celikyilmaz, Xian Li, Zornitsa Kozareva, Veselin Stoyanov, Mohit Bansal, and Srinivasan Iyer. 2023.  Methods for measuring, updating, and visualizing factual beliefs in language models. In _Proceedings of Conference of the European Chapter of the Association for Computational Linguistics_. 2714–2731.
  * He et al. (2023) Jinghan He, Haiyun Guo, Ming Tang, and Jinqiao Wang. 2023.  Continual instruction tuning for large multimodal models.  _arXiv preprint arXiv:2311.16206_ (2023).
  * He et al. (2021) Tianxing He, Jun Liu, Kyunghyun Cho, Myle Ott, Bing Liu, James Glass, and Fuchun Peng. 2021.  Analyzing the forgetting problem in pretrain-finetuning of open-domain dialogue response models. In _Proceedings of Conference of the European Chapter of the Association for Computational Linguistics_. 1121–1133.
  * Houlsby et al. (2019) Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019.  Parameter-efficient transfer learning for NLP. In _International conference on machine learning_. 2790–2799.
  * Hovy et al. (2006) Eduard Hovy, Mitch Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel. 2006.  OntoNotes: the 90% solution. In _Proceedings of the human language technology conference of the NAACL_. 57–60.
  * Hu et al. (2024) Chenhui Hu, Pengfei Cao, Yubo Chen, Kang Liu, and Jun Zhao. 2024.  WilKE: Wise-Layer Knowledge Editor for Lifelong Knowledge Editing.  _arXiv preprint arXiv:2402.10987_ (2024).
  * Hu et al. (2022) Chengwei Hu, Deqing Yang, Haoliang Jin, Zhen Chen, and Yanghua Xiao. 2022.  Improving Continual Relation Extraction through Prototypical Contrastive Learning. In _Proceedings of International Conference on Computational Linguistics_. 1885–1895.
  * Hu et al. (2021) Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al. 2021\.  LoRA: Low-Rank Adaptation of Large Language Models. In _International Conference on Learning Representations_.
  * Hua et al. (2021) Ting Hua, Yilin Shen, Changsheng Zhao, Yen-Chang Hsu, and Hongxia Jin. 2021.  Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 2669–2678.
  * Huang et al. (2024a) Jianheng Huang, Leyang Cui, Ante Wang, Chengyi Yang, Xinting Liao, Linfeng Song, Junfeng Yao, and Jinsong Su. 2024a.  Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal.  _arXiv preprint arXiv:2403.01244_ (2024).
  * Huang et al. (2024b) Jerry Huang, Prasanna Parthasarathi, Mehdi Rezagholizadeh, and Sarath Chandar. 2024b.  Towards Practical Tool Usage for Continually Learning LLMs.  _arXiv preprint arXiv:2404.09339_ (2024).
  * Huang et al. (2022a) Kaiyu Huang, Peng Li, Jin Ma, and Yang Liu. 2022a.  Entropy-based vocabulary substitution for incremental learning in multilingual neural machine translation. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 10537–10550.
  * Huang et al. (2023) Kaiyu Huang, Peng Li, Jin Ma, Ting Yao, and Yang Liu. 2023.  Knowledge transfer in incremental learning for multilingual neural machine translation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 15286–15304.
  * Huang et al. (2021) Yufan Huang, Yanzhe Zhang, Jiaao Chen, Xuezhi Wang, and Diyi Yang. 2021.  Continual Learning for Text Classification with Information Disentanglement Based Regularization. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 2736–2746.
  * Huang et al. (2022b) Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie Zhou, Wenge Rong, and Zhang Xiong. 2022b.  Transformer-Patcher: One Mistake Worth One Neuron. In _The Eleventh International Conference on Learning Representations_.
  * Ibrahim et al. (2024) Adam Ibrahim, Benjamin Thérien, Kshitij Gupta, Mats L Richter, Quentin Anthony, Timothée Lesort, Eugene Belilovsky, and Irina Rish. 2024.  Simple and Scalable Strategies to Continually Pre-train Large Language Models.  _arXiv preprint arXiv:2403.08763_ (2024).
  * Jaiswal et al. (2020) Ashish Jaiswal, Ashwin Ramesh Babu, Mohammad Zaki Zadeh, Debapriya Banerjee, and Fillia Makedon. 2020.  A survey on contrastive self-supervised learning.  _Technologies_ 9, 1 (2020), 2.
  * Jang et al. (2023) Joel Jang, Seungone Kim, Seonghyeon Ye, Doyoung Kim, Lajanugen Logeswaran, Moontae Lee, Kyungjae Lee, and Minjoon Seo. 2023.  Exploring the benefits of training expert language models over instruction tuning. In _International Conference on Machine Learning_. 14702–14729.
  * Jang et al. (2022) Joel Jang, Seonghyeon Ye, Changho Lee, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, and Minjoon Seo. 2022.  TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 6237–6250.
  * Jiang et al. (2023b) Wangjie Jiang, Zhihao Ye, Bang Liu, Ruihui Zhao, Jianguang Zheng, Mengyao Li, Zhiyong Li, Yujiu Yang, and Yefeng Zheng. 2023b.  Ica-proto: Iterative cross alignment prototypical network for incremental few-shot relation classification. In _Findings of EACL 2023_. 2275–2284.
  * Jiang et al. (2023a) Zhengbao Jiang, Frank F Xu, Luyu Gao, Zhiqing Sun, Qian Liu, Jane Dwivedi-Yu, Yiming Yang, Jamie Callan, and Graham Neubig. 2023a.  Active Retrieval Augmented Generation. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 7969–7992.
  * Jin et al. (2021) Xisen Jin, Bill Yuchen Lin, Mohammad Rostami, and Xiang Ren. 2021.  Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning. In _Findings of EMNLP_. 714–729.
  * Jin et al. (2022) Xisen Jin, Dejiao Zhang, Henghui Zhu, Wei Xiao, Shang-Wen Li, Xiaokai Wei, Andrew Arnold, and Xiang Ren. 2022.  Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 4764–4780.
  * Jovanovic and Voss (2024) Mladjan Jovanovic and Peter Voss. 2024.  Trends and Challenges of Real-time Learning in Large Language Models: A Critical Review.  _arXiv preprint arXiv:2404.18311_ (2024).
  * Kanwatchara et al. (2021) Kasidis Kanwatchara, Thanapapas Horsuwan, Piyawat Lertvittayakumjorn, Boonserm Kijsirikul, and Peerapon Vateekul. 2021.  Rational LAMOL: A rationale-based lifelong learning framework. In _Proceedings of Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing_. 2942–2953.
  * Karpukhin et al. (2020) Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020.  Dense Passage Retrieval for Open-Domain Question Answering. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 6769–6781.
  * Ke et al. (2022) Zixuan Ke, Haowei Lin, Yijia Shao, Hu Xu, Lei Shu, and Bing Liu. 2022.  Continual Training of Language Models for Few-Shot Learning. In _Proceedings of Empirical Methods in Natural Language Processing_. 10205–10216.
  * Ke et al. (2021a) Zixuan Ke, Bing Liu, Nianzu Ma, Hu Xu, and Lei Shu. 2021a.  Achieving forgetting prevention and knowledge transfer in continual learning.  _Advances in Neural Information Processing Systems_ 34 (2021), 22443–22456.
  * Ke et al. (2023a) Zixuan Ke, Bing Liu, Wenhan Xiong, Asli Celikyilmaz, and Haoran Li. 2023a.  Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks. In _Findings of EMNLP 2023_. 15090–15107.
  * Ke et al. (2021b) Zixuan Ke, Bing Liu, Hu Xu, and Lei Shu. 2021b.  CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_.
  * Ke et al. (2023b) Zixuan Ke, Yijia Shao, Haowei Lin, Tatsuya Konishi, Gyuhak Kim, and Bing Liu. 2023b.  Continual Pre-training of Language Models. In _The Eleventh International Conference on Learning Representations_.
  * Ke et al. (2021c) Zixuan Ke, Hu Xu, and Bing Liu. 2021c.  Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 4746–4755.
  * Khayrallah et al. (2018) Huda Khayrallah, Brian Thompson, Kevin Duh, and Philipp Koehn. 2018.  Regularized training objective for continued training for domain adaptation in neural machine translation. In _Proceedings of Workshop on Neural Machine Translation and Generation_. 36–44.
  * Kim et al. (2023b) Dahyun Kim, Chanjun Park, Sanghoon Kim, Wonsung Lee, Wonho Song, Yunsu Kim, Hyeonwoo Kim, Yungi Kim, Hyeonju Lee, Jihoo Kim, et al. 2023b.  Solar 10.7 b: Scaling large language models with simple yet effective depth up-scaling.  _arXiv preprint arXiv:2312.15166_ (2023).
  * Kim et al. (2023a) Gangwoo Kim, Sungdong Kim, Byeongguk Jeon, Joonsuk Park, and Jaewoo Kang. 2023a.  Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 996–1009.
  * Kirkpatrick et al. (2017) James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017\.  Overcoming catastrophic forgetting in neural networks.  _Proceedings of the national academy of sciences_ 114, 13 (2017), 3521–3526.
  * Korbak et al. (2022) Tomasz Korbak, Hady Elsahar, German Kruszewski, and Marc Dymetman. 2022.  Controlling Conditional Language Models without Catastrophic Forgetting. In _International Conference on Machine Learning_. PMLR, 11499–11528.
  * Kumar et al. (2023) Ritesh Kumar, Saurabh Goyal, Ashish Verma, and Vatche Isahagian. 2023.  ProtoNER: Few Shot Incremental Learning for Named Entity Recognition Using Prototypical Networks. In _International Conference on Business Process Management_. 70–82.
  * Larson et al. (2019) Stefan Larson, Anish Mahendran, Joseph J Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K Kummerfeld, Kevin Leach, Michael A Laurenzano, Lingjia Tang, et al. 2019\.  An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction. In _Proceedings of Empirical Methods in Natural Language Processing and the International Joint Conference on Natural Language Processing_. 1311–1316.
  * Lazaridou et al. (2021) Angeliki Lazaridou, Adhi Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d’Autume, Tomas Kocisky, Sebastian Ruder, et al. 2021\.  Mind the gap: Assessing temporal generalization in neural language models.  _Advances in Neural Information Processing Systems_ 34 (2021), 29348–29363.
  * Lee et al. (2022) Kyungjae Lee, Wookje Han, Seung-won Hwang, Hwaran Lee, Joonsuk Park, and Sang-Woo Lee. 2022.  Plug-and-Play Adaptation for Continuously-updated QA. In _Findings of ACL 2022_. 438–447.
  * Lee et al. (2021) Seanie Lee, Hae Beom Lee, Juho Lee, and Sung Ju Hwang. 2021.  Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning. In _International Conference on Learning Representations_.
  * Lermen et al. (2023) Simon Lermen, Charlie Rogers-Smith, and Jeffrey Ladish. 2023.  Lora fine-tuning efficiently undoes safety training in llama 2-chat 70b.  _arXiv preprint arXiv:2310.20624_ (2023).
  * Lesort et al. (2020) Timothée Lesort, Vincenzo Lomonaco, Andrei Stoian, Davide Maltoni, David Filliat, and Natalia Díaz-Rodríguez. 2020.  Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges.  _Information fusion_ 58 (2020), 52–68.
  * Lester et al. (2021) Brian Lester, Rami Al-Rfou, and Noah Constant. 2021.  The Power of Scale for Parameter-Efficient Prompt Tuning. In _Proceedings of Empirical Methods in Natural Language Processing_. 3045–3059.
  * Lewis et al. (2020) Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020\.  Retrieval-augmented generation for knowledge-intensive nlp tasks.  _Advances in Neural Information Processing Systems_ 33 (2020), 9459–9474.
  * Li and Lee (2024) Chen-An Li and Hung-Yi Lee. 2024.  Examining forgetting in continual pre-training of aligned large language models.  _arXiv preprint arXiv:2401.03129_ (2024).
  * Li et al. (2022a) Guodun Li, Yuchen Zhai, Qianglong Chen, Xing Gao, Ji Zhang, and Yin Zhang. 2022a.  Continual few-shot intent detection. In _Proceedings of the 29th international conference on computational linguistics_. 333–343.
  * Li et al. (2022b) Jia Li, Yunyan Zhang, Yifan Yang, Zhicheng An, and Yefeng Zheng. 2022b.  BNU: A Balance-Normalization-Uncertainty Model for Incremental Event Detection. In _IEEE International Conference on Acoustics, Speech and Signal Processing_. 6352–6356.
  * Li and Liang (2021) Xiang Lisa Li and Percy Liang. 2021.  Prefix-Tuning: Optimizing Continuous Prompts for Generation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing_. 4582–4597.
  * Li and Hoiem (2017) Zhizhong Li and Derek Hoiem. 2017.  Learning without forgetting.  _IEEE transactions on pattern analysis and machine intelligence_ 40, 12 (2017), 2935–2947.
  * Liang et al. (2023a) Chen Liang, Hongliang Li, Changhao Guan, Qingbin Liu, Jian Liu, Jinan Xu, and Zhe Zhao. 2023a.  Novel Slot Detection With an Incremental Setting. In _Findings of EMNLP 2023_. 737–746.
  * Liang and Li (2024) Yan-Shuo Liang and Wu-Jun Li. 2024.  InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning.  _arXiv preprint arXiv:2404.00228_ (2024).
  * Liang et al. (2023b) Zujie Liang, Feng Wei, Yin Jie, Yuxi Qian, Zhenghong Hao, and Bing Han. 2023b.  Prompts Can Play Lottery Tickets Well: Achieving Lifelong Information Extraction via Lottery Prompt Tuning. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 277–292.
  * Lin et al. (2023a) Yong Lin, Hangyu Lin, Wei Xiong, Shizhe Diao, Jianmeng Liu, Jipeng Zhang, Rui Pan, Haoxiang Wang, Wenbin Hu, Hanning Zhang, Hanze Dong, Renjie Pi, Han Zhao, Nan Jiang, Heng Ji, Yuan Yao, and Tong Zhang. 2023a.  Mitigating the Alignment Tax of RLHF.  arXiv:arXiv:2309.06256
  * Lin et al. (2023b) Yi Lin, Changhua Xu, Hang Yu, Pinzhuo Tian, and Xiangfeng Luo. 2023b.  Incremental event detection via an improved knowledge distillation based model.  _Neurocomputing_ 551 (2023), 126519.
  * Lin et al. (2024) Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, et al. 2024\.  Rho-1: Not All Tokens Are What You Need.  _arXiv preprint arXiv:2404.07965_ (2024).
  * Liu et al. (2022b) Haokun Liu, Derek Tam, Mohammed Muqeeth, Jay Mohta, Tenghao Huang, Mohit Bansal, and Colin A Raffel. 2022b.  Few-shot parameter-efficient fine-tuning is better and cheaper than in-context learning.  _Advances in Neural Information Processing Systems_ 35 (2022), 1950–1965.
  * Liu et al. (2023b) Junpeng Liu, Kaiyu Huang, Hao Yu, Jiuyi Li, Jinsong Su, and Degen Huang. 2023b.  Continual Learning for Multilingual Neural Machine Translation via Dual Importance-based Model Division. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 12011–12027.
  * Liu et al. (2022a) Minqian Liu, Shiyu Chang, and Lifu Huang. 2022a.  Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection. In _Proceedings of International Conference on Computational Linguistics_. 2157–2165.
  * Liu and Huang (2023) Minqian Liu and Lifu Huang. 2023.  Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extraction. In _Findings of ACL 2023_. 2241–2257.
  * Liu et al. (2021a) Qingbin Liu, Pengfei Cao, Cao Liu, Jiansong Chen, Xunliang Cai, Fan Yang, Shizhu He, Kang Liu, and Jun Zhao. 2021a.  Domain-lifelong learning for dialogue state tracking via knowledge preservation networks. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 2301–2311.
  * Liu et al. (2023a) Qingbin Liu, Yanchao Hao, Xiaolong Liu, Bo Li, Dianbo Sui, Shizhu He, Kang Liu, Jun Zhao, Xi Chen, Ningyu Zhang, et al. 2023a.  Class Lifelong Learning for Intent Detection via Structure Consolidation Networks. In _Findings of ACL 2023_. 293–306.
  * Liu et al. (2021c) Qingbin Liu, Xiaoyan Yu, Shizhu He, Kang Liu, and Jun Zhao. 2021c.  Lifelong intent detection via multi-strategy rebalancing.  _arXiv preprint arXiv:2108.04445_ (2021).
  * Liu et al. (2021b) Xingkun Liu, Arash Eshghi, Pawel Swietojanski, and Verena Rieser. 2021b.  Benchmarking natural language understanding services for building conversational agents. In _Increasing Naturalness and Flexibility in Spoken Dialogue Interaction: 10th International Workshop on Spoken Dialogue Systems_. 165–183.
  * Loureiro et al. (2022) Daniel Loureiro, Francesco Barbieri, Leonardo Neves, Luis Espinosa Anke, and Jose Camacho-Collados. 2022.  TimeLMs: Diachronic Language Models from Twitter. In _Proceedings of Annual Meeting of the Association for Computational Linguistics: System Demonstrations_. 251–260.
  * Lu et al. (2024) Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, and Jianfeng Gao. 2024.  Chameleon: Plug-and-play compositional reasoning with large language models.  _Advances in Neural Information Processing Systems_ 36 (2024).
  * Luo et al. (2023) Yun Luo, Xiaotian Lin, Zhen Yang, Fandong Meng, Jie Zhou, and Yue Zhang. 2023.  Mitigating catastrophic forgetting in task-incremental continual learning with adaptive classification criterion.  _arXiv preprint arXiv:2305.12270_ (2023).
  * Luu et al. (2022) Kelvin Luu, Daniel Khashabi, Suchin Gururangan, Karishma Mandyam, and Noah A Smith. 2022.  Time Waits for No One! Analysis and Challenges of Temporal Misalignment. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 5944–5958.
  * Ma et al. (2023a) Ruotian Ma, Xuanting Chen, Zhang Lin, Xin Zhou, Junzhe Wang, Tao Gui, Qi Zhang, Xiang Gao, and Yun Wen Chen. 2023a.  Learning “O” helps for learning more: Handling the unlabeled entity problem for class-incremental NER. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 5959–5979.
  * Ma et al. (2024) Shengkun Ma, Jiale Han, Yi Liang, and Bo Cheng. 2024.  Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors.  _arXiv preprint arXiv:2402.15713_ (2024).
  * Ma et al. (2023b) Shirong Ma, Shen Huang, Shulin Huang, Xiaobin Wang, Yangning Li, Hai-Tao Zheng, Pengjun Xie, Fei Huang, and Yong Jiang. 2023b.  Ecomgpt-ct: Continual pre-training of e-commerce large language models with semi-structured data.  _arXiv preprint arXiv:2312.15696_ (2023).
  * Madotto et al. (2021) Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou, Seungwhan Moon, Paul A Crook, Bing Liu, Zhou Yu, Eunjoon Cho, Pascale Fung, and Zhiguang Wang. 2021.  Continual Learning in Task-Oriented Dialogue Systems. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 7452–7467.
  * Maekawa et al. (2023) Aru Maekawa, Hidetaka Kamigaito, Kotaro Funakoshi, and Manabu Okumura. 2023.  Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language Learning. In _Proceedings of Conference of the European Chapter of the Association for Computational Linguistics_. 930–942.
  * McCloskey and Cohen (1989) Michael McCloskey and Neal J Cohen. 1989.  Catastrophic interference in connectionist networks: The sequential learning problem.  In _Psychology of learning and motivation_. Vol. 24. Elsevier, 109–165.
  * Mehta et al. (2023) Sanket Vaibhav Mehta, Darshan Patil, Sarath Chandar, and Emma Strubell. 2023.  An empirical investigation of the role of pre-training in lifelong learning.  _Journal of Machine Learning Research_ 24, 214 (2023), 1–50.
  * Menezes et al. (2023) Angelo G Menezes, Gustavo de Moura, Cézanne Alves, and André CPLF de Carvalho. 2023.  Continual object detection: a review of definitions, strategies, and challenges.  _Neural networks_ 161 (2023), 476–493.
  * Meng et al. (2022a) Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. 2022a.  Locating and editing factual associations in GPT.  _Advances in Neural Information Processing Systems_ 35 (2022), 17359–17372.
  * Meng et al. (2022b) Kevin Meng, Arnab Sen Sharma, Alex Andonian, Yonatan Belinkov, and David Bau. 2022b.  Mass-editing memory in a transformer.  _arXiv preprint arXiv:2210.07229_ (2022).
  * Mermillod et al. (2013) Martial Mermillod, Aurélia Bugaiska, and Patrick Bonin. 2013.  The stability-plasticity dilemma: Investigating the continuum from catastrophic forgetting to age-limited learning effects.  _Frontiers in psychology_ 4 (2013), 54654.
  * Mi et al. (2020) Fei Mi, Liangwei Chen, Mengjie Zhao, Minlie Huang, and Boi Faltings. 2020.  Continual Learning for Natural Language Generation in Task-oriented Dialog Systems. In _Findings of EMNLP_. 3461–3474.
  * Michieli and Ozay (2024) Umberto Michieli and Mete Ozay. 2024.  HOP to the Next Tasks and Domains for Continual Learning in NLP.  _arXiv preprint arXiv:2402.18449_ (2024).
  * Mishra et al. (2022) Swaroop Mishra, Daniel Khashabi, Chitta Baral, and Hannaneh Hajishirzi. 2022.  Cross-Task Generalization via Natural Language Crowdsourcing Instructions. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 3470–3487.
  * Mitchell et al. (2021) Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, and Christopher D Manning. 2021.  Fast model editing at scale.  _arXiv preprint arXiv:2110.11309_ (2021).
  * Module ([n. d.]) Selection Module. [n. d.].  SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models.  ([n. d.]).
  * Mok et al. (2023) Jisoo Mok, Jaeyoung Do, Sungjin Lee, Tara Taghavi, Seunghak Yu, and Sungroh Yoon. 2023.  Large-scale lifelong learning of in-context instructions and how to tackle it. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 12573–12589.
  * Monaikul et al. (2021) Natawut Monaikul, Giuseppe Castellucci, Simone Filice, and Oleg Rokhlenko. 2021.  Continual learning for named entity recognition. In _Proceedings of the AAAI Conference on Artificial Intelligence_ , Vol. 35. 13570–13577.
  * Murphy et al. (2010) Shawn N Murphy, Griffin Weber, Michael Mendis, Vivian Gainer, Henry C Chueh, Susanne Churchill, and Isaac Kohane. 2010.  Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2).  _Journal of the American Medical Informatics Association_ 17, 2 (2010), 124–130.
  * Nichol et al. (2018) Alex Nichol, Joshua Achiam, and John Schulman. 2018.  On first-order meta-learning algorithms.  _arXiv preprint arXiv:1803.02999_ (2018).
  * Obamuyide and Vlachos (2019) Abiola Obamuyide and Andreas Vlachos. 2019.  Meta-Learning Improves Lifelong Relation Extraction. In _Proceedings of the 4th Workshop on Representation Learning for NLP_. 224–229.
  * Parisi et al. (2019) German I Parisi, Ronald Kemker, Jose L Part, Christopher Kanan, and Stefan Wermter. 2019.  Continual lifelong learning with neural networks: A review.  _Neural networks_ 113 (2019), 54–71.
  * Pasunuru et al. (2021) Ramakanth Pasunuru, Veselin Stoyanov, and Mohit Bansal. 2021.  Continual few-shot learning for text classification. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 5688–5702.
  * Patil et al. (2023) Shishir G Patil, Tianjun Zhang, Xin Wang, and Joseph E Gonzalez. 2023.  Gorilla: Large language model connected with massive apis.  _arXiv preprint arXiv:2305.15334_ (2023).
  * Pearl (2009) Judea Pearl. 2009.  Causal inference in statistics: An overview.  (2009).
  * Qi et al. (2023) Xiangyu Qi, Yi Zeng, Tinghao Xie, Pin-Yu Chen, Ruoxi Jia, Prateek Mittal, and Peter Henderson. 2023.  Fine-tuning aligned language models compromises safety, even when users do not intend to!  _arXiv preprint arXiv:2310.03693_ (2023).
  * Qian et al. (2021) Jing Qian, Hong Wang, Mai ElSherief, and Xifeng Yan. 2021.  Lifelong Learning of Hate Speech Classification on Social Media. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 2304–2314.
  * Qin et al. (2023a) Chengwei Qin, CHEN CHEN, and Shafiq Joty. 2023a.  Lifelong Sequence Generation with Dynamic Module Expansion and Adaptation. In _Conference on Empirical Methods in Natural Language Processing_.
  * Qin and Joty (2021) Chengwei Qin and Shafiq Joty. 2021.  LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5. In _International Conference on Learning Representations_.
  * Qin and Joty (2022) Chengwei Qin and Shafiq Joty. 2022.  Continual Few-shot Relation Learning via Embedding Space Regularization and Data Augmentation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 2776–2789.
  * Qin et al. (2023b) Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, et al. 2023b.  Tool learning with foundation models.  _arXiv preprint arXiv:2304.08354_ (2023).
  * Qin et al. (2023c) Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, et al. 2023c.  Toolllm: Facilitating large language models to master 16000+ real-world apis.  _arXiv preprint arXiv:2307.16789_ (2023).
  * Qin et al. (2023d) Yujia Qin, Cheng Qian, Xu Han, Yankai Lin, Huadong Wang, Ruobing Xie, Zhiyuan Liu, Maosong Sun, and Jie Zhou. 2023d.  Recyclable Tuning for Continual Pre-training. In _Findings of ACL 2023_. 11403–11426.
  * Qin et al. (2022) Yujia Qin, Jiajie Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, and Jie Zhou. 2022.  ELLE: Efficient Lifelong Pre-training for Emerging Data. In _Findings of the Association for Computational Linguistics: ACL 2022_. 2789–2810.
  * Qiu et al. (2024) Shengjie Qiu, Junhao Zheng, Zhen Liu, Yicheng Luo, and Qianli Ma. 2024.  Incremental Sequence Labeling: A Tale of Two Shifts.  _arXiv preprint arXiv:2402.10447_ (2024).
  * Radford et al. (2021) Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021\.  Learning transferable visual models from natural language supervision. In _International conference on machine learning_. 8748–8763.
  * Radford et al. (2018) Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018\.  Improving language understanding by generative pre-training.  (2018).
  * Razdaibiedina et al. (2022) Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, and Amjad Almahairi. 2022.  Progressive Prompts: Continual Learning for Language Models. In _The Eleventh International Conference on Learning Representations_.
  * Reid et al. (2024) Machel Reid, Nikolay Savinov, Denis Teplyashin, Dmitry Lepikhin, Timothy Lillicrap, Jean-baptiste Alayrac, Radu Soricut, Angeliki Lazaridou, Orhan Firat, Julian Schrittwieser, et al. 2024\.  Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.  _arXiv preprint arXiv:2403.05530_ (2024).
  * Ren et al. (2024) Weijieying Ren, Xinlong Li, Lei Wang, Tianxiang Zhao, and Wei Qin. 2024.  Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning.  _arXiv preprint arXiv:2402.18865_ (2024).
  * Resta and Bacciu (2024) Michele Resta and Davide Bacciu. 2024.  Self-generated Replay Memories for Continual Neural Machine Translation.  arXiv:arXiv:2403.13130
  * Röttger and Pierrehumbert (2021) Paul Röttger and Janet Pierrehumbert. 2021.  Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media. In _Findings of EMNLP 2021_. 2400–2412.
  * Roy et al. (2024) Anurag Roy, Riddhiman Moulick, Vinay K Verma, Saptarshi Ghosh, and Abir Das. 2024.  Convolutional Prompting meets Language Models for Continual Learning.  _arXiv preprint arXiv:2403.20317_ (2024).
  * Scialom et al. (2022) Thomas Scialom, Tuhin Chakrabarty, and Smaranda Muresan. 2022.  Fine-tuned Language Models are Continual Learners. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 6107–6122.
  * Shaheen et al. (2022) Khadija Shaheen, Muhammad Abdullah Hanif, Osman Hasan, and Muhammad Shafique. 2022.  Continual learning for real-world autonomous systems: Algorithms, challenges and frameworks.  _Journal of Intelligent & Robotic Systems_ 105, 1 (2022), 9.
  * Shao and Feng (2022) Chenze Shao and Yang Feng. 2022.  Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 2023–2036.
  * Shao et al. (2023) Yijia Shao, Yiduo Guo, Dongyan Zhao, and Bing Liu. 2023.  Class-Incremental Learning based on Label Generation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 1263–1276.
  * Shazeer et al. (2016) Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. 2016.  Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. In _International Conference on Learning Representations_.
  * Shen et al. (2023a) Tianhao Shen, Renren Jin, Yufei Huang, Chuang Liu, Weilong Dong, Zishan Guo, Xinwei Wu, Yan Liu, and Deyi Xiong. 2023a.  Large language model alignment: A survey.  _arXiv preprint arXiv:2309.15025_ (2023).
  * Shen et al. (2019) Yilin Shen, Xiangyu Zeng, and Hongxia Jin. 2019.  A progressive model to enable continual learning for semantic slot filling. In _Proceedings of the Conference on Empirical Methods in Natural Language Processing and the International Joint Conference on Natural Language Processing_. 1279–1284.
  * Shen et al. (2023b) Yikang Shen, Zheyu Zhang, Tianyou Cao, Shawn Tan, Zhenfang Chen, and Chuang Gan. 2023b.  Moduleformer: Learning modular large language models from uncurated data.  _arXiv preprint arXiv:2306.04640_ (2023).
  * Shi et al. (2024) Haizhou Shi, Zihao Xu, Hengyi Wang, Weiyi Qin, Wenyuan Wang, Yibin Wang, and Hao Wang. 2024.  Continual Learning of Large Language Models: A Comprehensive Survey.  _arXiv preprint arXiv:2404.16789_ (2024).
  * Shin et al. (2017) Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim. 2017.  Continual learning with deep generative replay.  _Advances in neural information processing systems_ 30 (2017).
  * Singhal et al. (2023) Karan Singhal, Shekoofeh Azizi, Tao Tu, S Sara Mahdavi, Jason Wei, Hyung Won Chung, Nathan Scales, Ajay Tanwani, Heather Cole-Lewis, Stephen Pfohl, et al. 2023\.  Large language models encode clinical knowledge.  _Nature_ 620, 7972 (2023), 172–180.
  * Smith et al. (2023a) James Seale Smith, Yen-Chang Hsu, Lingyu Zhang, Ting Hua, Zsolt Kira, Yilin Shen, and Hongxia Jin. 2023a.  Continual diffusion: Continual customization of text-to-image diffusion with c-lora.  _arXiv preprint arXiv:2304.06027_ (2023).
  * Smith et al. (2023b) James Seale Smith, Leonid Karlinsky, Vyshnavi Gutta, Paola Cascante-Bonilla, Donghyun Kim, Assaf Arbelle, Rameswar Panda, Rogerio Feris, and Zsolt Kira. 2023b.  Coda-prompt: Continual decomposed attention-based prompting for rehearsal-free continual learning. In _Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition_. 11909–11919.
  * Song et al. (2023a) Chenyang Song, Xu Han, Zheni Zeng, Kuai Li, Chen Chen, Zhiyuan Liu, Maosong Sun, and Tao Yang. 2023a.  Conpet: Continual parameter-efficient tuning for large language models.  _arXiv preprint arXiv:2309.14763_ (2023).
  * Song et al. (2023b) Yifan Song, Peiyi Wang, Weimin Xiong, Dawei Zhu, Tianyu Liu, Zhifang Sui, and Sujian Li. 2023b.  InfoCL: Alleviating Catastrophic Forgetting in Continual Text Classification from An Information Theoretic Perspective. In _Findings of EMNLP 2023_. 14557–14570.
  * Stiennon et al. (2020) Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. 2020.  Learning to summarize with human feedback.  _Advances in Neural Information Processing Systems_ 33 (2020), 3008–3021.
  * Sun et al. (2019) Fan-Keng Sun, Cheng-Hao Ho, and Hung-Yi Lee. 2019.  LAMOL: LAnguage MOdeling for Lifelong Language Learning. In _International Conference on Learning Representations_.
  * Sun et al. (2020) Jingyuan Sun, Shaonan Wang, Jiajun Zhang, and Chengqing Zong. 2020.  Distill and replay for continual language learning. In _Proceedings of international conference on computational linguistics_. 3569–3579.
  * Sun et al. (2023) Mingjie Sun, Zhuang Liu, Anna Bair, and J Zico Kolter. 2023.  A Simple and Effective Pruning Approach for Large Language Models. In _The Twelfth International Conference on Learning Representations_.
  * Tang et al. (2023) Qiaoyu Tang, Ziliang Deng, Hongyu Lin, Xianpei Han, Qiao Liang, and Le Sun. 2023.  Toolalpaca: Generalized tool learning for language models with 3000 simulated cases.  _arXiv preprint arXiv:2306.05301_ (2023).
  * Thorne et al. (2018) James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018.  FEVER: a Large-scale Dataset for Fact Extraction and VERification. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 809–819.
  * Tian et al. (2024) Zonggui Tian, Du Zhang, and Hong-Ning Dai. 2024.  Continual Learning on Graphs: A Survey.  _arXiv preprint arXiv:2402.06330_ (2024).
  * Touvron et al. (2023) Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023\.  Llama: Open and efficient foundation language models.  _arXiv preprint arXiv:2302.13971_ (2023).
  * Trivedi et al. (2023) Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal. 2023.  Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 10014–10037.
  * Varshney et al. (2022) Vaibhav Varshney, Mayur Patidar, Rajat Kumar, Lovekesh Vig, and Gautam Shroff. 2022.  Prompt Augmented Generative Replay via Supervised Contrastive Learning for Lifelong Intent Detection. In _Findings of NAACL 2022_. 1113–1127.
  * Vijayaraghavan and Roy (2021) Prashanth Vijayaraghavan and Deb Roy. 2021.  Lifelong knowledge-enriched social event representation learning. In _Proceedings of Conference of the European Chapter of the Association for Computational Linguistics_. 3624–3635.
  * Völske et al. (2017) Michael Völske, Martin Potthast, Shahbaz Syed, and Benno Stein. 2017.  Tl; dr: Mining reddit to learn automatic summarization. In _Proceedings of the Workshop on New Frontiers in Summarization_. 59–63.
  * Wang et al. (2019a) Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2019a.  Superglue: A stickier benchmark for general-purpose language understanding systems.  _Advances in neural information processing systems_ 32 (2019).
  * Wang et al. (2018) Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R Bowman. 2018.  GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In _International Conference on Learning Representations_.
  * Wang et al. (2024c) Huiyi Wang, Haodong Lu, Lina Yao, and Dong Gong. 2024c.  Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning.  _arXiv preprint arXiv:2403.18886_ (2024).
  * Wang et al. (2024e) Hao Wang, Hanwen Shi, and Jianyong Duan. 2024e.  Few-shot Incremental Event Detection.  _ACM Transactions on Asian and Low-Resource Language Information Processing_ 23, 2 (2024), 1–20.
  * Wang et al. (2019b) Hong Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang, and William Yang Wang. 2019b.  Sentence Embedding Alignment for Lifelong Relation Extraction. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 796–806.
  * Wang et al. (2024d) Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. 2024d.  A survey on large language model based autonomous agents.  _Frontiers of Computer Science_ 18, 6 (2024), 1–26.
  * Wang et al. (2024f) Liyuan Wang, Xingxing Zhang, Hang Su, and Jun Zhu. 2024f.  A comprehensive survey of continual learning: Theory, method and application.  _IEEE Transactions on Pattern Analysis and Machine Intelligence_ (2024).
  * Wang et al. (2024a) Mingyang Wang, Heike Adel, Lukas Lange, Jannik Strötgen, and Hinrich Schütze. 2024a.  Rehearsal-Free Modular and Compositional Continual Learning for Language Models.  _arXiv preprint arXiv:2404.00790_ (2024).
  * Wang et al. (2023c) Peihao Wang, Rameswar Panda, and Zhangyang Wang. 2023c.  Data efficient neural scaling law via model reusing. In _International Conference on Machine Learning_. 36193–36204.
  * Wang et al. (2022b) Peiyi Wang, Yifan Song, Tianyu Liu, Rundong Gao, Binghuai Lin, Yunbo Cao, and Zhifang Sui. 2022b.  Less is more: Rethinking state-of-the-art continual relation extraction models with a frustratingly easy but effective approach.  _arXiv preprint arXiv:2209.00243_ (2022).
  * Wang et al. (2022c) Peiyi Wang, Yifan Song, Tianyu Liu, Binghuai Lin, Yunbo Cao, Sujian Li, and Zhifang Sui. 2022c.  Learning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentation. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 6264–6278.
  * Wang et al. (2022d) Rui Wang, Tong Yu, Handong Zhao, Sungchul Kim, Subrata Mitra, Ruiyi Zhang, and Ricardo Henao. 2022d.  Few-shot class-incremental learning for named entity recognition. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 571–582.
  * Wang et al. (2023e) Song Wang, Yaochen Zhu, Haochen Liu, Zaiyi Zheng, Chen Chen, et al. 2023e.  Knowledge editing for large language models: A survey.  _arXiv preprint arXiv:2310.16218_ (2023).
  * Wang et al. (2019c) Weikang Wang, Jiajun Zhang, Qian Li, Mei-Yuh Hwang, Chengqing Zong, and Zhifei Li. 2019c.  Incremental Learning from Scratch for Task-Oriented Dialogue Systems. In _Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics_. 3710–3720.
  * Wang et al. (2023a) Xiao Wang, Tianze Chen, Qiming Ge, Han Xia, Rong Bao, Rui Zheng, Qi Zhang, Tao Gui, and Xuan-Jing Huang. 2023a.  Orthogonal Subspace Learning for Language Model Continual Learning. In _Findings of EMNLP 2023_. 10658–10671.
  * Wang et al. (2023d) Xinyi Wang, Zitao Wang, and Wei Hu. 2023d.  Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction. In _Findings of ACL 2023_. 12693–12706.
  * Wang et al. (2024b) Yifan Wang, Yafei Liu, Chufan Shi, Haoling Li, Chen Chen, Haonan Lu, and Yujiu Yang. 2024b.  InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions.  _arXiv preprint arXiv:2403.11435_ (2024).
  * Wang et al. (2022a) Yizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi, Yeganeh Kordi, Amirreza Mirzaei, Atharva Naik, Arjun Ashok, Arut Selvan Dhanasekaran, Anjana Arunkumar, David Stap, et al. 2022a.  Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 5085–5109.
  * Wang et al. (2023b) Zhicheng Wang, Yufang Liu, Tao Ji, Xiaoling Wang, Yuanbin Wu, Congcong Jiang, Ye Chao, Zhencong Han, Ling Wang, Xu Shao, et al. 2023b.  Rehearsal-free continual language learning via efficient parameter isolation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 10933–10946.
  * Wang et al. (2022e) Zifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang, Ruoxi Sun, Xiaoqi Ren, Guolong Su, Vincent Perot, Jennifer Dy, and Tomas Pfister. 2022e.  Learning to prompt for continual learning. In _Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition_. 139–149.
  * Wei et al. (2022) Kaiwen Wei, Zequn Zhang, Li Jin, Zhi Guo, Shuchao Li, Weihong Wang, and Jianwei Lv. 2022.  HEFT: A History-Enhanced Feature Transfer framework for incremental event detection.  _Knowledge-Based Systems_ 254 (2022), 109601.
  * Wenzek et al. (2020) Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, Vishrav Chaudhary, Francisco Guzmán, Armand Joulin, and Édouard Grave. 2020.  CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data. In _Proceedings of the Twelfth Language Resources and Evaluation Conference_. 4003–4012.
  * Winata et al. (2023) Genta Winata, Lingjue Xie, Karthik Radhakrishnan, Shijie Wu, Xisen Jin, Pengxiang Cheng, Mayank Kulkarni, and Daniel Preoţiuc-Pietro. 2023.  Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning. In _Findings of ACL 2023_. 768–777.
  * Wistuba et al. (2023) Martin Wistuba, Lukas Balles, Giovanni Zappella, et al. 2023\.  Continual Learning with Low Rank Adaptation. In _NeurIPS 2023 Workshop on Distribution Shifts: New Frontiers with Foundation Models_.
  * Wu et al. (2024a) Chengyue Wu, Yukang Gan, Yixiao Ge, Zeyu Lu, Jiahao Wang, Ye Feng, Ping Luo, and Ying Shan. 2024a.  Llama pro: Progressive llama with block expansion.  _arXiv preprint arXiv:2401.02415_ (2024).
  * Wu et al. (2024b) Junhong Wu, Yuchen Liu, and Chengqing Zong. 2024b.  F-MALLOC: Feed-forward Memory Allocation for Continual Learning in Neural Machine Translation.  _arXiv preprint arXiv:2404.04846_ (2024).
  * Wu et al. (2021) Tongtong Wu, Xuekai Li, Yuan-Fang Li, Gholamreza Haffari, Guilin Qi, Yujin Zhu, and Guoqiang Xu. 2021.  Curriculum-meta learning for order-robust continual relation extraction. In _Proceedings of the AAAI conference on artificial intelligence_ , Vol. 35. 10363–10369.
  * Wu et al. (2024c) Tongtong Wu, Linhao Luo, Yuan-Fang Li, Shirui Pan, Thuy-Trang Vu, and Gholamreza Haffari. 2024c.  Continual learning for large language models: A survey.  _arXiv preprint arXiv:2402.01364_ (2024).
  * Xia et al. (2021) Congying Xia, Wenpeng Yin, Yihao Feng, and Philip Yu. 2021.  Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and System. In _Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies_. 1351–1360.
  * Xia et al. (2023) Heming Xia, Peiyi Wang, Tianyu Liu, Binghuai Lin, Yunbo Cao, and Zhifang Sui. 2023.  Enhancing Continual Relation Extraction via Classifier Decomposition. In _Findings of ACL 2023_. 10053–10062.
  * Xia et al. (2024) Mengzhou Xia, Sadhika Malladi, Suchin Gururangan, Sanjeev Arora, and Danqi Chen. 2024.  Less: Selecting influential data for targeted instruction tuning.  _arXiv preprint arXiv:2402.04333_ (2024).
  * Xia et al. (2022) Yu Xia, Quan Wang, Yajuan Lyu, Yong Zhu, Wenhao Wu, Sujian Li, and Dai Dai. 2022.  Learn and review: Enhancing continual named entity recognition via reviewing synthetic samples. In _Findings of ACL 2022_. 2291–2300.
  * Xie et al. (2023b) Jian Xie, Yidan Liang, Jingping Liu, Yanghua Xiao, Baohua Wu, and Shenghua Ni. 2023b.  Quert: Continual pre-training of language model for query understanding in travel domain search. In _Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining_. 5282–5291.
  * Xie et al. (2023a) Yong Xie, Karan Aggarwal, and Aitzaz Ahmad. 2023a.  Efficient continual pre-training for building domain specific large language models.  _arXiv preprint arXiv:2311.08545_ (2023).
  * Yadav et al. (2023) Prateek Yadav, Qing Sun, Hantian Ding, Xiaopeng Li, Dejiao Zhang, Ming Tan, Parminder Bhatia, Xiaofei Ma, Ramesh Nallapati, Murali Krishna Ramanathan, et al. 2023\.  Exploring Continual Learning for Code Generation Models. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 782–792.
  * Yang et al. (2024b) Bang Yang, Yong Dai, Xuxin Cheng, Yaowei Li, Asif Raza, and Yuexian Zou. 2024b.  Embracing Language Inclusivity and Diversity in CLIP through Continual Language Learning.  _arXiv preprint arXiv:2401.17186_ (2024).
  * Yang et al. (2023) Hongyang Yang, Xiao-Yang Liu, and Christina Dan Wang. 2023.  FinGPT: Open-Source Financial Large Language Models.  _FinLLM at IJCAI_ (2023).
  * Yang et al. (2024c) Li Yang, Zhipeng Luo, Shiming Zhang, Fei Teng, and Tianrui Li. 2024c.  Continual Learning for Smart City: A Survey.  _arXiv preprint arXiv:2404.00983_ (2024).
  * Yang et al. (2024d) Rui Yang, Lin Song, Yanwei Li, Sijie Zhao, Yixiao Ge, Xiu Li, and Ying Shan. 2024d.  Gpt4tools: Teaching large language model to use tools via self-instruction.  _Advances in Neural Information Processing Systems_ 36 (2024).
  * Yang et al. (2024a) Shu Yang, Muhammad Asif Ali, Cheng-Long Wang, Lijie Hu, and Di Wang. 2024a.  MoRAL: MoE Augmented LoRA for LLMs’ Lifelong Learning.  _arXiv preprint arXiv:2402.11260_ (2024).
  * Yıldız et al. (2024) Çağatay Yıldız, Nishaanth Kanna Ravichandran, Prishruit Punia, Matthias Bethge, and Beyza Ermis. 2024.  Investigating Continual Pretraining in Large Language Models: Insights and Implications.  _arXiv preprint arXiv:2402.17400_ (2024).
  * Yin et al. (2022) Wenpeng Yin, Jia Li, and Caiming Xiong. 2022.  ConTinTin: Continual Learning from Task Instructions. In _60th Annual Meeting of the Association for Computational Linguistics, ACL 2022_. Association for Computational Linguistics (ACL), 3062–3072.
  * Yoon et al. (2019) Jaehong Yoon, Saehoon Kim, Eunho Yang, and Sung Ju Hwang. 2019.  Scalable and Order-robust Continual Learning with Additive Parameter Decomposition. In _International Conference on Learning Representations_.
  * Yu et al. (2021) Pengfei Yu, Heng Ji, and Prem Natarajan. 2021.  Lifelong event detection with knowledge transfer. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 5278–5290.
  * Yuan and Zhao (2023) Bo Yuan and Danpei Zhao. 2023.  A Survey on Continual Semantic Segmentation: Theory, Challenge, Method and Application.  _arXiv preprint arXiv:2310.14277_ (2023).
  * Yuan et al. (2023) Qiao Yuan, Sheng-Uei Guan, Pin Ni, Tianlun Luo, Ka Lok Man, Prudence Wong, and Victor Chang. 2023.  Continual graph learning: A survey.  _arXiv preprint arXiv:2301.12230_ (2023).
  * Zan et al. (2022) Daoguang Zan, Bei Chen, Dejian Yang, Zeqi Lin, Minsu Kim, Bei Guan, Yongji Wang, Weizhu Chen, and Jian-Guang Lou. 2022.  CERT: Continual Pre-training on Sketches for Library-oriented Code Generation. In _Proceedings of International Joint Conference on Artificial Intelligence_. 2369–2375.
  * Zeng et al. (2022) Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, et al. 2022\.  GLM-130B: An Open Bilingual Pre-trained Model. In _International Conference on Learning Representations_.
  * Zhan et al. (2023) Qiusi Zhan, Richard Fang, Rohan Bindu, Akul Gupta, Tatsunori Hashimoto, and Daniel Kang. 2023.  Removing rlhf protections in gpt-4 via fine-tuning.  _arXiv preprint arXiv:2311.05553_ (2023).
  * Zhang et al. (2024a) Chenlong Zhang, Pengfei Cao, Yubo Chen, Kang Liu, Zhiqiang Zhang, Mengshu Sun, and Jun Zhao. 2024a.  Continual Few-shot Event Detection via Hierarchical Augmentation Networks.  _arXiv preprint arXiv:2403.17733_ (2024).
  * Zhang et al. (2023a) Duzhen Zhang, Wei Cong, Jiahua Dong, Yahan Yu, Xiuyi Chen, Yonggang Zhang, and Zhen Fang. 2023a.  Continual Named Entity Recognition without Catastrophic Forgetting. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 8186–8197.
  * Zhang et al. (2023c) Duzhen Zhang, Hongliu Li, Wei Cong, Rongtao Xu, Jiahua Dong, and Xiuyi Chen. 2023c.  Task relation distillation and prototypical pseudo label for incremental named entity recognition. In _Proceedings of the 32nd ACM International Conference on Information and Knowledge Management_. 3319–3329.
  * Zhang et al. (2023f) Duzhen Zhang, Yahan Yu, Feilong Chen, and Xiuyi Chen. 2023f.  Decomposing logits distillation for incremental named entity recognition. In _Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval_. 1919–1923.
  * Zhang et al. (2024b) Han Zhang, Lin Gui, Yu Lei, Yuanzhao Zhai, Yehong Zhang, Yulan He, Hui Wang, Yue Yu, Kam-Fai Wong, Bin Liang, et al. 2024b.  COPR: Continual Human Preference Learning via Optimal Policy Regularization.  _arXiv preprint arXiv:2402.14228_ (2024).
  * Zhang et al. ([n. d.]) Han Zhang, Yu Lei, Lin Gui, Min Yang, Yulan He, Hui Wang, and Ruifeng Xu. [n. d.].  CPPO: Continual Learning for Reinforcement Learning with Human Feedback.  ([n. d.]).
  * Zhang et al. (2022a) Han Zhang, Bin Liang, Min Yang, Hui Wang, and Ruifeng Xu. 2022a.  Prompt-based prototypical framework for continual relation extraction.  _IEEE/ACM Transactions on Audio, Speech, and Language Processing_ 30 (2022), 2801–2813.
  * Zhang et al. (2022c) Han Zhang, Sheng Zhang, Yang Xiang, Bin Liang, Jinsong Su, Zhongjian Miao, Hui Wang, and Ruifeng Xu. 2022c.  CLLE: A benchmark for continual language learning evaluation in multilingual machine translation. In _Findings of EMNLP 2022_. 428–443.
  * Zhang and Choi (2023) Michael Zhang and Eunsol Choi. 2023.  Mitigating Temporal Misalignment by Discarding Outdated Facts. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 14213–14226.
  * Zhang et al. (2023e) Songming Zhang, Yunlong Liang, Shuaibo Wang, Yufeng Chen, Wenjuan Han, Jian Liu, and Jinan Xu. 2023e.  Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 8062–8079.
  * Zhang et al. (2015) Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015.  Character-level convolutional networks for text classification.  _Advances in neural information processing systems_ 28 (2015).
  * Zhang and Chen (2023) Yunan Zhang and Qingcai Chen. 2023.  A neural span-based continual named entity recognition model. In _Proceedings of the AAAI Conference on Artificial Intelligence_ , Vol. 37. 13993–14001.
  * Zhang et al. (2023d) Yuanchi Zhang, Peng Li, Maosong Sun, and Yang Liu. 2023d.  Continual Knowledge Distillation for Neural Machine Translation. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 7978–7996.
  * Zhang et al. (2022b) Yanzhe Zhang, Xuezhi Wang, and Diyi Yang. 2022b.  Continual Sequence Generation with Adaptive Compositional Modules. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 3653–3667.
  * Zhang et al. (2017) Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, and Christopher D Manning. 2017.  Position-aware Attention and Supervised Data Improve Slot Filling. In _Proceedings of Empirical Methods in Natural Language Processing_. 35–45.
  * Zhang et al. (2023b) Zihan Zhang, Meng Fang, Ling Chen, Mohammad Reza Namazi Rad, and Jun Wang. 2023b.  How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances. In _Empirical Methods in Natural Language Processing_.
  * Zhao et al. (2024) Bowen Zhao, Zander Brumbaugh, Yizhong Wang, Hannaneh Hajishirzi, and Noah A Smith. 2024.  Set the Clock: Temporal Alignment of Pretrained Language Models.  _arXiv preprint arXiv:2402.16797_ (2024).
  * Zhao et al. (2023b) Jiachen Zhao, Zhun Deng, David Madras, James Zou, and Mengye Ren. 2023b.  Learning and forgetting unsafe examples in large language models.  _arXiv preprint arXiv:2312.12736_ (2023).
  * Zhao et al. (2023c) Jiawei Zhao, Yifei Zhang, Beidi Chen, Florian Schäfer, and Anima Anandkumar. 2023c.  Inrank: Incremental low-rank learning.  _arXiv preprint arXiv:2306.11250_ (2023).
  * Zhao et al. (2022a) Kang Zhao, Hua Xu, Jiangong Yang, and Kai Gao. 2022a.  Consistent Representation Learning for Continual Relation Extraction. In _Findings of ACL 2022_. 3402–3411.
  * Zhao et al. (2023a) Wenzheng Zhao, Yuanning Cui, and Wei Hu. 2023a.  Improving Continual Relation Extraction by Distinguishing Analogous Semantics. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 1162–1175.
  * Zhao et al. (2022b) Yingxiu Zhao, Yinhe Zheng, Zhiliang Tian, Chang Gao, Jian Sun, and Nevin L Zhang. 2022b.  Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 11153–11169.
  * Zheng et al. (2022) Junhao Zheng, Zhanxian Liang, Haibin Chen, and Qianli Ma. 2022.  Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition. In _Proceedings of Conference on Empirical Methods in Natural Language Processing_. 3602–3615.
  * Zheng et al. (2024a) Junhao Zheng, Qianli Ma, Zhen Liu, Binquan Wu, and Huawen Feng. 2024a.  Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer.  _arXiv preprint arXiv:2401.09181_ (2024).
  * Zheng et al. (2023a) Junhao Zheng, Qianli Ma, Shengjie Qiu, Yue Wu, Peitian Ma, Junlong Liu, Huawen Feng, Xichen Shang, and Haibin Chen. 2023a.  Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 9155–9173.
  * Zheng et al. (2023b) Junhao Zheng, Shengjie Qiu, and Qianli Ma. 2023b.  Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models.  _arXiv preprint arXiv:2312.07887_ (2023).
  * Zheng et al. (2024b) Junhao Zheng, Shengjie Qiu, and Qianli Ma. 2024b.  Concept-1K: A Novel Benchmark for Instance Incremental Learning.  _arXiv preprint arXiv:2402.08526_ (2024).
  * Zheng et al. (2024c) Junhao Zheng, Ruiyan Wang, Chongzhi Zhang, Huawen Feng, and Qianli Ma. 2024c.  Balancing the Causal Effects in Class-Incremental Learning.  _arXiv preprint arXiv:2402.10063_ (2024).
  * Zhou et al. (2024) Da-Wei Zhou, Hai-Long Sun, Jingyi Ning, Han-Jia Ye, and De-Chuan Zhan. 2024.  Continual Learning with Pre-Trained Models: A Survey.  _arXiv preprint arXiv:2401.16386_ (2024).
  * Zhu et al. (2022a) Qi Zhu, Bing Li, Fei Mi, Xiaoyan Zhu, and Minlie Huang. 2022a.  Continual Prompt Tuning for Dialog State Tracking. In _Proceedings of Annual Meeting of the Association for Computational Linguistics_. 1124–1137.
  * Zhu et al. (2022b) Tao Zhu, Zhe Zhao, Weijie Liu, Jiachi Liu, Yiren Chen, Weiquan Mao, Haoyan Liu, Kunbo Ding, Yudong Li, and Xuefeng Yang. 2022b.  Parameter-efficient Continual Learning Framework in Industrial Real-time Text Classification System. In _Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Track_. 315–323.