Create README.md

README.md

@@ -0,0 +1,64 @@
+---
+license: apache-2.0
+tags:
+- generated_from_trainer
+metrics:
+- squad
+model-index:
+- name: roberta-base-fineTuned-squadV1QA
+  results: []
+---
+
+# t5-v1_1-base-squadV2AutoQgen
+
+This model is a fine-tuned version of [roberta-base](roberta-base) on SQUAD dataset.
+It achieves the following results on the evaluation set:
+{'exact_match': 86.14001892147587, 'f1': 92.33036616751536}
+
+## Model description
+
+roberta-base has been fine-tuned with SQUAD dataset with QuestionAnswering LM Head.
+
+## Intended uses & limitations
+
+The model intended to be used for Q&A task, given the context and question, model would attempt to infer answer text, answer span and probability scores.
+
+## Training and evaluation data
+
+SQUAD Split
+
+## Training procedure
+
+Preprocessing:
+1. SQUAD Data longer chunks were sub-chunked with input context max-length 384 tokens and stride as 128 tokens.
+2. Target answers readjusted for sub-chunks, sub-chunks with no-answers or partial answers were set to target answer span as (0,0)
+
+Metrics:
+1. Adjusted accordingly to handle sub-chunking.
+2. n best = 20
+3. skip answers with length zero or higher than max answer length (30)
+
+### Training hyperparameters
+Custom Training Loop:
+The following hyperparameters were used during training:
+- learning_rate: 2e-5
+- train_batch_size: 32
+- eval_batch_size: 32
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 2
+
+### Training results
+
+| Epoch | F1       | Exact Match | 
+|:-----:|:--------:|:-----------:|
+| 1.0   | 91.3085  | 84.5412     |
+| 2.0   | 92.3304  | 86.1400     |
+
+
+### Framework versions
+
+- Transformers 4.23.0.dev0
+- Pytorch 1.12.1+cu113
+- Datasets 2.5.2
+- Tokenizers 0.13.0