Stanford University; Department of Computer Science, Stanford University
Michael Zhang, Kush Bhatia, Hermann Kumbong, Christopher Re
linear attention;transformers
The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry