Update README.md
Browse files
README.md
CHANGED
@@ -70,7 +70,7 @@ We build the Doge by doing Per-Training on [Smollm-Corpus](https://huggingface.c
|
|
70 |
| [Doge-20M](https://huggingface.co/SmallDoge/Doge-20M) | 25.4 | 0.03 | 29.8 | 58.4 | 27.3 | 25.6 | 50.2 | 142 |
|
71 |
| [Doge-60M](https://huggingface.co/SmallDoge/Doge-60M) | 26.4 | 0.2 | 37.9 | 61.4 | 31.5 | 28.0 | 50.8 | 62 |
|
72 |
| [Doge-160M](https://huggingface.co/SmallDoge/Doge-160M) | 29.2 | 4.8 | 44.4 | 70.1 | 43.4 | 34.4 | 52.2 | 28 |
|
73 |
-
| [Doge-320M](https://huggingface.co/SmallDoge/Doge-320M) | 33.8 | 9.4 | 52.1 | 73.9 | 52.7 | 37.9 | 55.
|
74 |
|
75 |
> [!NOTE]
|
76 |
> All evaluations are done using five-shot settings, without additional training on the benchmarks.
|
@@ -92,9 +92,10 @@ We build the Doge by doing Per-Training on [Smollm-Corpus](https://huggingface.c
|
|
92 |
|
93 |
```bibtex
|
94 |
@misc{smalldoges,
|
95 |
-
title={SmallDoges},
|
96 |
-
author={
|
97 |
year={2025},
|
98 |
-
month={March},
|
|
|
99 |
}
|
100 |
```
|
|
|
70 |
| [Doge-20M](https://huggingface.co/SmallDoge/Doge-20M) | 25.4 | 0.03 | 29.8 | 58.4 | 27.3 | 25.6 | 50.2 | 142 |
|
71 |
| [Doge-60M](https://huggingface.co/SmallDoge/Doge-60M) | 26.4 | 0.2 | 37.9 | 61.4 | 31.5 | 28.0 | 50.8 | 62 |
|
72 |
| [Doge-160M](https://huggingface.co/SmallDoge/Doge-160M) | 29.2 | 4.8 | 44.4 | 70.1 | 43.4 | 34.4 | 52.2 | 28 |
|
73 |
+
| [Doge-320M](https://huggingface.co/SmallDoge/Doge-320M) | 33.8 | 9.4 | 52.1 | 73.9 | 52.7 | 37.9 | 55.3 | 16 |
|
74 |
|
75 |
> [!NOTE]
|
76 |
> All evaluations are done using five-shot settings, without additional training on the benchmarks.
|
|
|
92 |
|
93 |
```bibtex
|
94 |
@misc{smalldoges,
|
95 |
+
title={SmallDoges: A Family of Dynamic UltraFast Small Language Models},
|
96 |
+
author={Jingze, Shi and Yifan, Wu and Bingheng, Wu and Yuyu, Luo},
|
97 |
year={2025},
|
98 |
+
month={March},
|
99 |
+
url={https://github.com/SmallDoges/small-doge}
|
100 |
}
|
101 |
```
|