microsoft/xtremedistil-l6-h256-uncased fined-tuned on SQuAD (https://huggingface.co/datasets/squad)

Hyperparameters:

epochs: 1
lr: 1e-5
train batch sie: 16
optimizer: adamW
lr_scheduler: linear
num warming steps: 0
max_length: 512

Results on the dev set:

'exact_match': 62.66792809839168
'f1': 74.99490608582015

Downloads last month: 3

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train haritzpuerto/xtremedistil-l6-h256-uncased-squad_1.1

Evaluation results

SQuAD EM on SQuAD
validation set self-reported

62.668
SQuAD F1 on SQuAD
validation set self-reported

74.995

View on Papers With Code