Update README.md
Browse files
README.md
CHANGED
|
@@ -3,4 +3,12 @@ license: apache-2.0
|
|
| 3 |
---
|
| 4 |
|
| 5 |
|
| 6 |
-
WIP
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
|
| 6 |
+
WIP
|
| 7 |
+
|
| 8 |
+
(pretrained=aloobun/d-SmolLM2-360M,dtype=bfloat16), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: auto (4)
|
| 9 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 10 |
+
|----------------------------|-------|------|-----:|--------|---|-----:|---|-----:|
|
| 11 |
+
|leaderboard_gpqa | N/A| | | | | | | |
|
| 12 |
+
| - leaderboard_gpqa_diamond | 1|none | 0|acc_norm|↑ |0.2071|± |0.0289|
|
| 13 |
+
| - leaderboard_gpqa_extended| 1|none | 0|acc_norm|↑ |0.2308|± |0.0180|
|
| 14 |
+
| - leaderboard_gpqa_main | 1|none | 0|acc_norm|↑ |0.2679|± |0.0209|
|