metadata

license: mit
tags:
  - generated_from_trainer
model-index:
  - name: bert-portuguese-squad2
    results: []

bert-portuguese-squad2

This model is a fine-tuned version of neuralmind/bert-base-portuguese-cased on SQuAD_v2 dataset, translated for portuguese.

Model description

More information needed

Evaluation

{'exact': 75.76715597879051, 'f1': 86.10779795627346, 'total': 130319, 'HasAns_exact': 66.280047453957, 'HasAns_f1': 81.80143193308851, 'HasAns_total': 86821, 'NoAns_exact': 94.70320474504575, 'NoAns_f1': 94.70320474504575, 'NoAns_total': 43498, 'best_exact': 75.77176006568497, 'best_exact_thresh': 0.0, 'best_f1': 86.11240204317286, 'best_f1_thresh': 0.0}

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 3

Framework versions

Transformers 4.24.0
Pytorch 1.13.0+cu117
Datasets 2.6.1
Tokenizers 0.13.2