Department of Computer Science, Princeton University; Department of Computer Science, Stanford University
Tri Dao
Attention;GPUs;LLM training;LLM inference
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning