EPFL; University of Geneva
Matteo Pagliardini, Daniele Paliotta, Martin Jaggi, François Fleuret
self-attention;large language models;transformers
Fast Attention Over Long Sequences With Dynamic Sparse Flash Attention