cs.CL cs.LG
RedPajama: an Open Dataset for Training Large Language Models
Maurice Weber Daniel Y Fu Quentin Gregory Anthony Yonatan Oren Shane Adams Anton Alexandrov Xiaozhong Lyu Huu Nguyen Xiaozhe Yao Virginia Adams Ben Athiwaratkun Rahul Chalamala Kezhen Chen Max Ryabinin Tri Dao Percy Liang Christopher Re Irina Rish Ce Zhang