Forgetting Transformer: Softmax Attention with a Forget Gate Paper • 2503.02130 • Published 8 days ago • 26
L^2M: Mutual Information Scaling Law for Long-Context Language Modeling Paper • 2503.04725 • Published 6 days ago • 19