Running 1.42k 1.42k The Ultra-Scale Playbook π The ultimate guide to training LLM on large GPU Clusters
view article Article Fine-tuning LLMs to 1.58bit: extreme quantization made easy Sep 18, 2024 β’ 223
Running 112 112 Open-LLM performances are plateauing, letβs make the leaderboard steep again π Update leaderboard for fair model evaluation
view article Article Llama-3.1-Storm-8B: Improved SLM with Self-Curation + Model Merging By akjindal53244 β’ Aug 19, 2024 β’ 77
view article Article A failed experiment: Infini-Attention, and why we should keep trying? Aug 14, 2024 β’ 59
Running on Zero 28 28 Gpt2 Multiplication Predictor π Multiply large numbers using different reasoning methods
Running 775 775 FineWeb: decanting the web for the finest text data at scale π· Generate high-quality web text data for LLM training