Llama-3.1-Storm-8B: Improved SLM with Self-Curation + Model Merging
•
76
Ashvini Kumar Jindal
akjindal53244
AI & ML interests
NLP
Recent Activity
upvoted
an
article
7 days ago
SmolLM - blazingly fast and remarkably powerful
new activity
about 2 months ago
akjindal53244/Llama-3.1-Storm-8B:Adding Evaluation Results
reacted
to
albertvillanova's
post
with 👍
4 months ago
🚨 We’ve just released a new tool to compare the performance of models in the 🤗 Open LLM Leaderboard: the Comparator 🎉
https://huggingface.co/spaces/open-llm-leaderboard/comparator
Want to see how two different versions of LLaMA stack up? Let’s walk through a step-by-step comparison of LLaMA-3.1 and LLaMA-3.2. 🦙🧵👇
1/ Load the Models' Results
- Go to the 🤗 Open LLM Leaderboard Comparator: https://huggingface.co/spaces/open-llm-leaderboard/comparator
- Search for "LLaMA-3.1" and "LLaMA-3.2" in the model dropdowns.
- Press the Load button. Ready to dive into the results!
2/ Compare Metric Results in the Results Tab 📊
- Head over to the Results tab.
- Here, you’ll see the performance metrics for each model, beautifully color-coded using a gradient to highlight performance differences: greener is better! 🌟
- Want to focus on a specific task? Use the Task filter to hone in on comparisons for tasks like BBH or MMLU-Pro.
3/ Check Config Alignment in the Configs Tab ⚙️
- To ensure you’re comparing apples to apples, head to the Configs tab.
- Review both models’ evaluation configurations, such as metrics, datasets, prompts, few-shot configs...
- If something looks off, it’s good to know before drawing conclusions! ✅
4/ Compare Predictions by Sample in the Details Tab 🔍
- Curious about how each model responds to specific inputs? The Details tab is your go-to!
- Select a Task (e.g., MuSR) and then a Subtask (e.g., Murder Mystery) and then press the Load Details button.
- Check out the side-by-side predictions and dive into the nuances of each model’s outputs.
5/ With this tool, it’s never been easier to explore how small changes between model versions affect performance on a wide range of tasks. Whether you’re a researcher or enthusiast, you can instantly visualize improvements and dive into detailed comparisons.
🚀 Try the 🤗 Open LLM Leaderboard Comparator now and take your model evaluations to the next level!
Articles
Organizations
akjindal53244's activity
liked
a
dataset
5 months ago
liked
a
model
5 months ago
liked
a
Space
5 months ago
liked
2
datasets
6 months ago
liked
2
models
6 months ago
liked
a
dataset
6 months ago
liked
a
model
7 months ago
liked
3
datasets
8 months ago
liked
a
model
10 months ago
liked
a
dataset
10 months ago
liked
a
Space
12 months ago
liked
2
models
over 1 year ago
liked
a
Space
over 1 year ago