Independent Researcher; CMU, Google Research; Yale University; Yale University, Google Research; Google Research
Insu Han, Rajesh Jayaram, Amin Karbasi, Vahab Mirrokni, David Woodruff, Amir Zandieh
self-attention;locality sensitive hashing;long-range context
HyperAttention: Long-context Attention in Near-Linear Time