Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ language:
|
|
| 7 |
|
| 8 |
# Nordavind-7B
|
| 9 |
|
| 10 |
-
A model trained on top of <https://huggingface.co/norallm/normistral-7b-warm> on various Norwegian instruct data.
|
| 11 |
Runtime: ~20 hours on a V100 32GB. Final loss: `1.301`.
|
| 12 |
|
| 13 |
Prompt format:
|
|
|
|
| 7 |
|
| 8 |
# Nordavind-7B
|
| 9 |
|
| 10 |
+
A model trained on top of <https://huggingface.co/norallm/normistral-7b-warm> on various Norwegian instruct data with a context length of 4096. The name - *nordavind* - a cold wind from the north, is derived from Mistral. See https://en.wikipedia.org/wiki/Mistral_(wind)!
|
| 11 |
Runtime: ~20 hours on a V100 32GB. Final loss: `1.301`.
|
| 12 |
|
| 13 |
Prompt format:
|