view article Article TerjamaBench: A Cultural Benchmark for English-Darija Machine Translation By imomayiz and 4 others • 28 days ago • 27
view article Article Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference 22 days ago • 63
view article Article Train 400x faster Static Embedding Models with Sentence Transformers 23 days ago • 138
view article Article CO₂ Emissions and Models Performance: Insights from the Open LLM Leaderboard 29 days ago • 18
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards Paper • 2402.01781 • Published Feb 1, 2024 • 2
Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Though Paper • 2501.04682 • Published 30 days ago • 90
CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings Paper • 2501.01257 • Published Jan 2 • 48
ProcessBench: Identifying Process Errors in Mathematical Reasoning Paper • 2412.06559 • Published Dec 9, 2024 • 79
Data Laundering: Artificially Boosting Benchmark Results through Knowledge Distillation Paper • 2412.15255 • Published Dec 15, 2024 • 3
Falcon3 Collection Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters. • 40 items • Updated about 1 month ago • 80
Multilingual LLM Evaluation Collection Multilingual Evaluation Benchmarks • 6 items • Updated Dec 13, 2024 • 10
🧪 FineWeb v1 data experiments Collection Ablation models trained for our data experiments. • 22 items • Updated Jun 12, 2024 • 5
📀 Dataset comparison models Collection 1.8B models trained on 350BT to compare different pretraining datasets • 8 items • Updated Jun 12, 2024 • 37