RWKV-7 "Goose" with Expressive Dynamic State Evolution Paper • 2503.14456 • Published Mar 18 • 153 • 11
Running 3.14k 3.14k The Ultra-Scale Playbook 🌌 The ultimate guide to training LLM on large GPU Clusters
GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression Paper • 2407.12077 • Published Jul 16, 2024 • 57