Princeton University; Virginia Tech; IBM Research
Xiangyu Qi, Yi Zeng, Tinghao Xie, Pin-Yu Chen, Ruoxi Jia, Prateek Mittal, Peter Henderson
AI Safety;Large Language Models;Fine-tuning;Jailbreaking;AI Alignment
Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!