Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Bo Peng Daniel Goldstein Quentin Gregory Anthony Alon Albalak Eric Alcaide Stella Biderman Eugene Cheah Teddy Ferdinan Kranthi Kiran GV Haowen Hou Satyapriya Krishna Ronald McClelland Jr. Niklas Muennighoff Fares Obeid Atsushi Saito Guangyu Song Haoqin Tu Ruichong Zhang Bingchen Zhao Qihang Zhao Jian Zhu Rui-Jie Zhu