Department of Computer Science, Northwestern University, Evanston, IL 60208 USA; Department of Statistics and Data Science, Northwestern University, Evanston, IL 60208 USA; Department of Physics, National Taiwan University, Taipei 10617, Taiwan
Jerry Yao-Chieh Hu, Donglin Yang, Dennis Wu, Chenwei Xu, Bo-Yu Chen, Han Liu
Hopfield Models; Modern Hopfield Networks; Sparse Attention; Memory Networks
On Sparse Modern Hopfield Model