Hugging Face's logo

vasudevgupta
/
flax-bigbird-natural-questions

Transformers
JAX
English
big_bird
Inference Endpoints
Model card Files Community
1
vasudevgupta commited on
Commit
5e93670
·
1 Parent(s): 39dbc92

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -2
README.md CHANGED
@@ -9,8 +9,6 @@ widget:
9
 
10
  This checkpoint is obtained after training `FlaxBigBirdForQuestionAnswering` (with extra pooler head) on [`natural_questions`](https://huggingface.co/datasets/natural_questions) dataset on TPU v3-8. This dataset takes around ~100 GB on disk. But thanks to Cloud TPUs and Jax, each epoch took just 4.5 hours. Script for training can be found here: https://github.com/vasudevgupta7/bigbird
11
 
12
- ![bigbird](bigbird.mov)
13
-
14
  **Use this model just like any other model from 🤗Transformers**
15
 
16
  ```python
 
9
 
10
  This checkpoint is obtained after training `FlaxBigBirdForQuestionAnswering` (with extra pooler head) on [`natural_questions`](https://huggingface.co/datasets/natural_questions) dataset on TPU v3-8. This dataset takes around ~100 GB on disk. But thanks to Cloud TPUs and Jax, each epoch took just 4.5 hours. Script for training can be found here: https://github.com/vasudevgupta7/bigbird
11
 
 
 
12
  **Use this model just like any other model from 🤗Transformers**
13
 
14
  ```python