Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,9 @@ base_model:
|
|
4 |
- FacebookAI/roberta-base
|
5 |
---
|
6 |
|
7 |
-
#
|
8 |
|
9 |
<!-- Provide a quick summary of what the model is/does. -->
|
10 |
-
Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.
|
|
|
|
|
|
4 |
- FacebookAI/roberta-base
|
5 |
---
|
6 |
|
7 |
+
# Longformer 8192
|
8 |
|
9 |
<!-- Provide a quick summary of what the model is/does. -->
|
10 |
+
Longformer model with 8192 tokens sequence length. Initialized from [FaceboookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base). No additional pre-training has been done.
|
11 |
+
|
12 |
+
Model can be loaded and run using AutoModel and AutoTokenizer.
|