Columbia University, New York, NY, USA; Adobe Research, Seattle, WA, USA
Josh Alman, Zhao Song
Attention computation;kronecker computation
How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation