Update README.md
Browse files
README.md
CHANGED
|
@@ -70,7 +70,7 @@ print(tokenizer.decode(output))
|
|
| 70 |
## Model Details
|
| 71 |
|
| 72 |
- **Model type:** Transformer-based Language Model
|
| 73 |
-
- **Total seen tokens
|
| 74 |
|
| 75 |
|Params|Layers|Hidden size|Heads|Context length|Embedding parameters|Non-embedding parameters|
|
| 76 |
|:---:|:---:|:---:|:---:|:---:|:---:|:---:|
|
|
|
|
| 70 |
## Model Details
|
| 71 |
|
| 72 |
- **Model type:** Transformer-based Language Model
|
| 73 |
+
- **Total seen tokens:** 2.1T tokens
|
| 74 |
|
| 75 |
|Params|Layers|Hidden size|Heads|Context length|Embedding parameters|Non-embedding parameters|
|
| 76 |
|:---:|:---:|:---:|:---:|:---:|:---:|:---:|
|