
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# swinv2-tiny-patch4-window8-256-finetuned-eurosat

This model is a fine-tuned version of [microsoft/swinv2-tiny-patch4-window8-256](https://huggingface.co/microsoft/swinv2-tiny-patch4-window8-256) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0776
- Accuracy: 0.9686
- Precision Overall: 0.9697
- Recall Overall: 0.9686
- F1 Overall: 0.9679
- Precision T0: 0.9333
- Recall T0: 0.7368
- F1 T0: 0.8235
- Precision T1: 0.8893
- Recall T1: 0.9765
- F1 T1: 0.9308
- Precision T2: 0.9939
- Recall T2: 0.9889
- F1 T2: 0.9914

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 128
- eval_batch_size: 128
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 512
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Accuracy | Precision Overall | Recall Overall | F1 Overall | Precision T0 | Recall T0 | F1 T0  | Precision T1 | Recall T1 | F1 T1  | Precision T2 | Recall T2 | F1 T2  |
|:-------------:|:-------:|:----:|:---------------:|:--------:|:-----------------:|:--------------:|:----------:|:------------:|:---------:|:------:|:------------:|:---------:|:------:|:------------:|:---------:|:------:|
| 1.4522        | 0.9524  | 10   | 1.1098          | 0.2801   | 0.7200            | 0.2801         | 0.3433     | 0.1199       | 0.9053    | 0.2118 | 0.0303       | 0.0392    | 0.0342 | 0.9555       | 0.2821    | 0.4356 |
| 0.9137        | 1.9286  | 20   | 0.6271          | 0.7386   | 0.5455            | 0.7386         | 0.6276     | 0.0          | 0.0       | 0.0    | 0.0          | 0.0       | 0.0    | 0.7386       | 1.0       | 0.8497 |
| 0.6332        | 2.9048  | 30   | 0.5053          | 0.7498   | 0.6819            | 0.7498         | 0.6553     | 0.0          | 0.0       | 0.0    | 0.6667       | 0.0627    | 0.1147 | 0.7513       | 0.9990    | 0.8576 |
| 0.4977        | 3.9762  | 41   | 0.3550          | 0.8656   | 0.8133            | 0.8656         | 0.8374     | 0.0          | 0.0       | 0.0    | 0.6511       | 0.8196    | 0.7257 | 0.9332       | 0.9606    | 0.9467 |
| 0.396         | 4.9524  | 51   | 0.3010          | 0.8820   | 0.8191            | 0.8820         | 0.8494     | 0.0          | 0.0       | 0.0    | 0.7279       | 0.7765    | 0.7514 | 0.9213       | 0.9939    | 0.9562 |
| 0.3438        | 5.9286  | 61   | 0.2886          | 0.8730   | 0.8732            | 0.8730         | 0.8659     | 0.4182       | 0.4842    | 0.4488 | 0.8424       | 0.5451    | 0.6619 | 0.9248       | 0.9949    | 0.9586 |
| 0.3112        | 6.9048  | 71   | 0.2835          | 0.8574   | 0.8846            | 0.8574         | 0.8492     | 0.3626       | 0.6526    | 0.4662 | 0.8850       | 0.3922    | 0.5435 | 0.9346       | 0.9970    | 0.9648 |
| 0.2826        | 7.9762  | 82   | 0.2100          | 0.9149   | 0.9115            | 0.9149         | 0.9103     | 0.6437       | 0.5895    | 0.6154 | 0.9005       | 0.7098    | 0.7939 | 0.9401       | 0.9990    | 0.9686 |
| 0.2627        | 8.9524  | 92   | 0.2164          | 0.9081   | 0.9144            | 0.9081         | 0.9060     | 0.5484       | 0.7158    | 0.6210 | 0.9066       | 0.6471    | 0.7551 | 0.9516       | 0.9939    | 0.9723 |
| 0.2385        | 9.9286  | 102  | 0.2145          | 0.9089   | 0.9217            | 0.9089         | 0.9065     | 0.5515       | 0.7895    | 0.6494 | 0.9576       | 0.6196    | 0.7524 | 0.9480       | 0.9949    | 0.9709 |
| 0.2448        | 10.9048 | 112  | 0.2168          | 0.9111   | 0.9216            | 0.9111         | 0.9093     | 0.5746       | 0.8105    | 0.6725 | 0.9425       | 0.6431    | 0.7646 | 0.9496       | 0.9899    | 0.9693 |
| 0.2353        | 11.9762 | 123  | 0.1721          | 0.9276   | 0.9302            | 0.9276         | 0.9252     | 0.6729       | 0.7579    | 0.7129 | 0.9534       | 0.7216    | 0.8214 | 0.9490       | 0.9970    | 0.9724 |
| 0.2207        | 12.9524 | 133  | 0.1434          | 0.9447   | 0.9431            | 0.9447         | 0.9418     | 0.8986       | 0.6526    | 0.7561 | 0.9185       | 0.8392    | 0.8770 | 0.9537       | 1.0       | 0.9763 |
| 0.1997        | 13.9286 | 143  | 0.1606          | 0.9283   | 0.9290            | 0.9283         | 0.9264     | 0.6635       | 0.7263    | 0.6935 | 0.9220       | 0.7412    | 0.8217 | 0.9563       | 0.9960    | 0.9757 |
| 0.2022        | 14.9048 | 153  | 0.1486          | 0.9380   | 0.9392            | 0.9380         | 0.9329     | 0.9796       | 0.5053    | 0.6667 | 0.8544       | 0.8745    | 0.8643 | 0.9572       | 0.9960    | 0.9762 |
| 0.1899        | 15.9762 | 164  | 0.1402          | 0.9425   | 0.9420            | 0.9425         | 0.9409     | 0.7812       | 0.7895    | 0.7853 | 0.9355       | 0.7961    | 0.8602 | 0.9591       | 0.9949    | 0.9767 |
| 0.1925        | 16.9524 | 174  | 0.1338          | 0.9432   | 0.9413            | 0.9432         | 0.9410     | 0.8767       | 0.6737    | 0.7619 | 0.8893       | 0.8510    | 0.8697 | 0.9609       | 0.9929    | 0.9766 |
| 0.177         | 17.9286 | 184  | 0.1521          | 0.9395   | 0.9408            | 0.9395         | 0.9351     | 0.9608       | 0.5158    | 0.6712 | 0.8407       | 0.8902    | 0.8648 | 0.9646       | 0.9929    | 0.9786 |
| 0.1889        | 18.9048 | 194  | 0.1357          | 0.9447   | 0.9442            | 0.9447         | 0.9415     | 0.9508       | 0.6105    | 0.7436 | 0.8871       | 0.8627    | 0.8748 | 0.9583       | 0.9980    | 0.9777 |
| 0.1972        | 19.9762 | 205  | 0.1303          | 0.9462   | 0.9444            | 0.9462         | 0.9441     | 0.8701       | 0.7053    | 0.7791 | 0.9185       | 0.8392    | 0.8770 | 0.9582       | 0.9970    | 0.9772 |
| 0.1923        | 20.9524 | 215  | 0.1344          | 0.9403   | 0.9412            | 0.9403         | 0.9389     | 0.7308       | 0.8       | 0.7638 | 0.9431       | 0.7804    | 0.8541 | 0.9609       | 0.9949    | 0.9776 |
| 0.1859        | 21.9286 | 225  | 0.1228          | 0.9455   | 0.9431            | 0.9455         | 0.9434     | 0.8228       | 0.6842    | 0.7471 | 0.9076       | 0.8471    | 0.8763 | 0.9638       | 0.9960    | 0.9796 |
| 0.1784        | 22.9048 | 235  | 0.1194          | 0.9470   | 0.9452            | 0.9470         | 0.9448     | 0.8889       | 0.6737    | 0.7665 | 0.8907       | 0.8627    | 0.8765 | 0.9647       | 0.9949    | 0.9796 |
| 0.175         | 23.9762 | 246  | 0.1190          | 0.9432   | 0.9426            | 0.9432         | 0.9421     | 0.7449       | 0.7684    | 0.7565 | 0.9156       | 0.8078    | 0.8583 | 0.9685       | 0.9949    | 0.9815 |
| 0.1722        | 24.9524 | 256  | 0.1204          | 0.9477   | 0.9461            | 0.9477         | 0.9461     | 0.8068       | 0.7474    | 0.7760 | 0.9254       | 0.8275    | 0.8737 | 0.9648       | 0.9980    | 0.9811 |
| 0.1727        | 25.9286 | 266  | 0.1168          | 0.9492   | 0.9473            | 0.9492         | 0.9475     | 0.8519       | 0.7263    | 0.7841 | 0.9114       | 0.8471    | 0.8780 | 0.9657       | 0.9970    | 0.9811 |
| 0.1774        | 26.9048 | 276  | 0.1190          | 0.9507   | 0.9513            | 0.9507         | 0.9497     | 0.7822       | 0.8316    | 0.8061 | 0.9585       | 0.8157    | 0.8814 | 0.9657       | 0.9970    | 0.9811 |
| 0.1769        | 27.9762 | 287  | 0.1093          | 0.9500   | 0.9484            | 0.9500         | 0.9481     | 0.8904       | 0.6842    | 0.7738 | 0.892        | 0.8745    | 0.8832 | 0.9685       | 0.9949    | 0.9815 |
| 0.1536        | 28.9524 | 297  | 0.1069          | 0.9507   | 0.9496            | 0.9507         | 0.9484     | 0.9275       | 0.6737    | 0.7805 | 0.9024       | 0.8706    | 0.8862 | 0.9639       | 0.9980    | 0.9806 |
| 0.1625        | 29.9286 | 307  | 0.1022          | 0.9559   | 0.9549            | 0.9559         | 0.9544     | 0.9211       | 0.7368    | 0.8187 | 0.9253       | 0.8745    | 0.8992 | 0.9658       | 0.9980    | 0.9816 |
| 0.1596        | 30.9048 | 317  | 0.1000          | 0.9552   | 0.9539            | 0.9552         | 0.9542     | 0.8409       | 0.7789    | 0.8087 | 0.9205       | 0.8627    | 0.8907 | 0.9733       | 0.9960    | 0.9845 |
| 0.166         | 31.9762 | 328  | 0.1028          | 0.9537   | 0.9522            | 0.9537         | 0.9526     | 0.8372       | 0.7579    | 0.7956 | 0.9095       | 0.8667    | 0.8876 | 0.9743       | 0.9949    | 0.9845 |
| 0.1507        | 32.9524 | 338  | 0.1034          | 0.9500   | 0.9498            | 0.9500         | 0.9495     | 0.77         | 0.8105    | 0.7897 | 0.9149       | 0.8431    | 0.8776 | 0.9761       | 0.9909    | 0.9834 |
| 0.1603        | 33.9286 | 348  | 0.0991          | 0.9515   | 0.9499            | 0.9515         | 0.9502     | 0.8554       | 0.7474    | 0.7978 | 0.8980       | 0.8627    | 0.8800 | 0.9723       | 0.9939    | 0.9830 |
| 0.1431        | 34.9048 | 358  | 0.1069          | 0.9507   | 0.9542            | 0.9507         | 0.9492     | 0.9836       | 0.6316    | 0.7692 | 0.8362       | 0.9412    | 0.8856 | 0.9818       | 0.9838    | 0.9828 |
| 0.1504        | 35.9762 | 369  | 0.1035          | 0.9544   | 0.9562            | 0.9544         | 0.9522     | 0.9833       | 0.6211    | 0.7613 | 0.8613       | 0.9255    | 0.8922 | 0.9781       | 0.9939    | 0.9860 |
| 0.1429        | 36.9524 | 379  | 0.0987          | 0.9567   | 0.9574            | 0.9567         | 0.9547     | 0.9531       | 0.6421    | 0.7673 | 0.8713       | 0.9294    | 0.8994 | 0.9801       | 0.9939    | 0.9869 |
| 0.1471        | 37.9286 | 389  | 0.1180          | 0.9507   | 0.9542            | 0.9507         | 0.9470     | 0.9804       | 0.5263    | 0.6849 | 0.8368       | 0.9451    | 0.8877 | 0.982        | 0.9929    | 0.9874 |
| 0.1421        | 38.9048 | 399  | 0.1058          | 0.9507   | 0.9562            | 0.9507         | 0.9492     | 0.9831       | 0.6105    | 0.7532 | 0.82         | 0.9647    | 0.8865 | 0.9888       | 0.9798    | 0.9843 |
| 0.1342        | 39.9762 | 410  | 0.0953          | 0.9567   | 0.9586            | 0.9567         | 0.9546     | 0.9836       | 0.6316    | 0.7692 | 0.8664       | 0.9412    | 0.9023 | 0.9800       | 0.9919    | 0.9859 |
| 0.1434        | 40.9524 | 420  | 0.0937          | 0.9612   | 0.9648            | 0.9612         | 0.9596     | 0.9839       | 0.6421    | 0.7771 | 0.8527       | 0.9765    | 0.9104 | 0.9919       | 0.9879    | 0.9899 |
| 0.1401        | 41.9286 | 430  | 0.0875          | 0.9619   | 0.9609            | 0.9619         | 0.9612     | 0.8523       | 0.7895    | 0.8197 | 0.9268       | 0.8941    | 0.9102 | 0.9801       | 0.9960    | 0.9880 |
| 0.1342        | 42.9048 | 440  | 0.0875          | 0.9597   | 0.9586            | 0.9597         | 0.9587     | 0.8765       | 0.7474    | 0.8068 | 0.9059       | 0.9059    | 0.9059 | 0.9801       | 0.9939    | 0.9869 |
| 0.1363        | 43.9762 | 451  | 0.1002          | 0.9597   | 0.9611            | 0.9597         | 0.9574     | 0.9836       | 0.6316    | 0.7692 | 0.8791       | 0.9412    | 0.9091 | 0.9801       | 0.9960    | 0.9880 |
| 0.1375        | 44.9524 | 461  | 0.1123          | 0.9552   | 0.9560            | 0.9552         | 0.9523     | 0.9831       | 0.6105    | 0.7532 | 0.8893       | 0.9137    | 0.9014 | 0.9705       | 0.9990    | 0.9846 |
| 0.1373        | 45.9286 | 471  | 0.1053          | 0.9567   | 0.9579            | 0.9567         | 0.9544     | 0.9836       | 0.6316    | 0.7692 | 0.8773       | 0.9255    | 0.9008 | 0.9762       | 0.9960    | 0.9860 |
| 0.135         | 46.9048 | 481  | 0.0947          | 0.9589   | 0.9615            | 0.9589         | 0.9573     | 0.9683       | 0.6421    | 0.7722 | 0.8566       | 0.9608    | 0.9057 | 0.9879       | 0.9889    | 0.9884 |
| 0.1319        | 47.9762 | 492  | 0.0995          | 0.9567   | 0.9601            | 0.9567         | 0.9548     | 0.9833       | 0.6211    | 0.7613 | 0.8478       | 0.9608    | 0.9007 | 0.9869       | 0.9879    | 0.9874 |
| 0.1318        | 48.9524 | 502  | 0.0882          | 0.9604   | 0.9604            | 0.9604         | 0.9599     | 0.8875       | 0.7474    | 0.8114 | 0.8810       | 0.9294    | 0.9046 | 0.9879       | 0.9889    | 0.9884 |
| 0.134         | 49.9286 | 512  | 0.0872          | 0.9589   | 0.9587            | 0.9589         | 0.9583     | 0.8765       | 0.7474    | 0.8068 | 0.8797       | 0.9176    | 0.8983 | 0.9869       | 0.9899    | 0.9884 |
| 0.1233        | 50.9048 | 522  | 0.0858          | 0.9627   | 0.9651            | 0.9627         | 0.9618     | 0.9565       | 0.6947    | 0.8049 | 0.8606       | 0.9686    | 0.9114 | 0.9929       | 0.9869    | 0.9899 |
| 0.1277        | 51.9762 | 533  | 0.0905          | 0.9612   | 0.9630            | 0.9612         | 0.9605     | 0.9178       | 0.7053    | 0.7976 | 0.8601       | 0.9647    | 0.9094 | 0.9939       | 0.9848    | 0.9893 |
| 0.1301        | 52.9524 | 543  | 0.0870          | 0.9634   | 0.9645            | 0.9634         | 0.9628     | 0.92         | 0.7263    | 0.8118 | 0.875        | 0.9608    | 0.9159 | 0.9919       | 0.9869    | 0.9894 |
| 0.1237        | 53.9286 | 553  | 0.0947          | 0.9619   | 0.9626            | 0.9619         | 0.9605     | 0.9420       | 0.6842    | 0.7927 | 0.8836       | 0.9529    | 0.9170 | 0.9849       | 0.9909    | 0.9879 |
| 0.1244        | 54.9048 | 563  | 0.0936          | 0.9604   | 0.9611            | 0.9604         | 0.9590     | 0.9559       | 0.6842    | 0.7975 | 0.8856       | 0.9412    | 0.9125 | 0.981        | 0.9919    | 0.9864 |
| 0.1247        | 55.9762 | 574  | 0.0946          | 0.9634   | 0.9648            | 0.9634         | 0.9629     | 0.9211       | 0.7368    | 0.8187 | 0.8723       | 0.9647    | 0.9162 | 0.9929       | 0.9848    | 0.9888 |
| 0.1179        | 56.9524 | 584  | 0.0930          | 0.9656   | 0.9677            | 0.9656         | 0.9644     | 0.9701       | 0.6842    | 0.8025 | 0.8768       | 0.9765    | 0.9239 | 0.9909       | 0.9899    | 0.9904 |
| 0.1249        | 57.9286 | 594  | 0.0906          | 0.9634   | 0.9647            | 0.9634         | 0.9623     | 0.9429       | 0.6947    | 0.8000 | 0.875        | 0.9608    | 0.9159 | 0.9899       | 0.9899    | 0.9899 |
| 0.1258        | 58.9048 | 604  | 0.0866          | 0.9627   | 0.9628            | 0.9627         | 0.9621     | 0.8875       | 0.7474    | 0.8114 | 0.8856       | 0.9412    | 0.9125 | 0.9899       | 0.9889    | 0.9894 |
| 0.1168        | 59.9762 | 615  | 0.0886          | 0.9574   | 0.9586            | 0.9574         | 0.9574     | 0.8452       | 0.7474    | 0.7933 | 0.8602       | 0.9412    | 0.8989 | 0.9949       | 0.9818    | 0.9883 |
| 0.1267        | 60.9524 | 625  | 0.0951          | 0.9619   | 0.9624            | 0.9619         | 0.9605     | 0.9420       | 0.6842    | 0.7927 | 0.8864       | 0.9490    | 0.9167 | 0.9840       | 0.9919    | 0.9879 |
| 0.1211        | 61.9286 | 635  | 0.0914          | 0.9612   | 0.9622            | 0.9612         | 0.9597     | 0.9552       | 0.6737    | 0.7901 | 0.8804       | 0.9529    | 0.9153 | 0.9839       | 0.9909    | 0.9874 |
| 0.1258        | 62.9048 | 645  | 0.0857          | 0.9649   | 0.9659            | 0.9649         | 0.9640     | 0.9444       | 0.7158    | 0.8144 | 0.8845       | 0.9608    | 0.9211 | 0.9889       | 0.9899    | 0.9894 |
| 0.1165        | 63.9762 | 656  | 0.0831          | 0.9679   | 0.9681            | 0.9679         | 0.9675     | 0.9012       | 0.7684    | 0.8295 | 0.8971       | 0.9569    | 0.9260 | 0.9929       | 0.9899    | 0.9914 |
| 0.1166        | 64.9524 | 666  | 0.0841          | 0.9634   | 0.9634            | 0.9634         | 0.9634     | 0.8065       | 0.7895    | 0.7979 | 0.9073       | 0.9216    | 0.9144 | 0.9929       | 0.9909    | 0.9919 |
| 0.117         | 65.9286 | 676  | 0.0885          | 0.9627   | 0.9643            | 0.9627         | 0.9615     | 0.9420       | 0.6842    | 0.7927 | 0.8693       | 0.9647    | 0.9145 | 0.9909       | 0.9889    | 0.9899 |
| 0.1173        | 66.9048 | 686  | 0.0879          | 0.9656   | 0.9657            | 0.9656         | 0.9646     | 0.9452       | 0.7263    | 0.8214 | 0.9064       | 0.9490    | 0.9272 | 0.9830       | 0.9929    | 0.9879 |
| 0.1133        | 67.9762 | 697  | 0.0850          | 0.9664   | 0.9681            | 0.9664         | 0.9656     | 0.9444       | 0.7158    | 0.8144 | 0.8768       | 0.9765    | 0.9239 | 0.9939       | 0.9879    | 0.9909 |
| 0.1186        | 68.9524 | 707  | 0.0872          | 0.9642   | 0.9657            | 0.9642         | 0.9634     | 0.9315       | 0.7158    | 0.8095 | 0.8728       | 0.9686    | 0.9182 | 0.9929       | 0.9869    | 0.9899 |
| 0.1181        | 69.9286 | 717  | 0.0842          | 0.9694   | 0.9704            | 0.9694         | 0.9687     | 0.9333       | 0.7368    | 0.8235 | 0.8893       | 0.9765    | 0.9308 | 0.9949       | 0.9899    | 0.9924 |
| 0.1062        | 70.9048 | 727  | 0.0856          | 0.9686   | 0.9693            | 0.9686         | 0.9680     | 0.9342       | 0.7474    | 0.8304 | 0.8945       | 0.9647    | 0.9283 | 0.9919       | 0.9909    | 0.9914 |
| 0.1159        | 71.9762 | 738  | 0.0878          | 0.9656   | 0.9682            | 0.9656         | 0.9648     | 0.9565       | 0.6947    | 0.8049 | 0.8651       | 0.9804    | 0.9191 | 0.9959       | 0.9879    | 0.9919 |
| 0.1162        | 72.9524 | 748  | 0.0851          | 0.9642   | 0.9644            | 0.9642         | 0.9643     | 0.8021       | 0.8105    | 0.8063 | 0.9141       | 0.9176    | 0.9159 | 0.9929       | 0.9909    | 0.9919 |
| 0.1201        | 73.9286 | 758  | 0.0828          | 0.9694   | 0.9703            | 0.9694         | 0.9685     | 0.9452       | 0.7263    | 0.8214 | 0.8957       | 0.9765    | 0.9343 | 0.9919       | 0.9909    | 0.9914 |
| 0.1145        | 74.9048 | 768  | 0.0865          | 0.9656   | 0.9670            | 0.9656         | 0.9642     | 0.9552       | 0.6737    | 0.7901 | 0.8826       | 0.9725    | 0.9254 | 0.9899       | 0.9919    | 0.9909 |
| 0.1172        | 75.9762 | 779  | 0.0835          | 0.9694   | 0.9693            | 0.9694         | 0.9692     | 0.8539       | 0.8       | 0.8261 | 0.9129       | 0.9451    | 0.9287 | 0.9949       | 0.9919    | 0.9934 |
| 0.1077        | 76.9524 | 789  | 0.0896          | 0.9679   | 0.9695            | 0.9679         | 0.9669     | 0.9571       | 0.7053    | 0.8121 | 0.8834       | 0.9804    | 0.9294 | 0.9929       | 0.9899    | 0.9914 |
| 0.1093        | 77.9286 | 799  | 0.0808          | 0.9686   | 0.9696            | 0.9686         | 0.9681     | 0.9221       | 0.7474    | 0.8256 | 0.8889       | 0.9725    | 0.9288 | 0.9949       | 0.9889    | 0.9919 |
| 0.1114        | 78.9048 | 809  | 0.0823          | 0.9642   | 0.9651            | 0.9642         | 0.9639     | 0.8889       | 0.7579    | 0.8182 | 0.8781       | 0.9608    | 0.9176 | 0.9949       | 0.9848    | 0.9898 |
| 0.1144        | 79.9762 | 820  | 0.0867          | 0.9686   | 0.9705            | 0.9686         | 0.9675     | 0.9706       | 0.6947    | 0.8098 | 0.8838       | 0.9843    | 0.9314 | 0.9929       | 0.9909    | 0.9919 |
| 0.1101        | 80.9524 | 830  | 0.0786          | 0.9679   | 0.9675            | 0.9679         | 0.9673     | 0.8889       | 0.7579    | 0.8182 | 0.9101       | 0.9529    | 0.9310 | 0.9899       | 0.9919    | 0.9909 |
| 0.1053        | 81.9286 | 840  | 0.0874          | 0.9679   | 0.9697            | 0.9679         | 0.9669     | 0.9571       | 0.7053    | 0.8121 | 0.8807       | 0.9843    | 0.9296 | 0.9939       | 0.9889    | 0.9914 |
| 0.1019        | 82.9048 | 850  | 0.0842          | 0.9642   | 0.9660            | 0.9642         | 0.9640     | 0.9114       | 0.7579    | 0.8276 | 0.8702       | 0.9725    | 0.9185 | 0.9959       | 0.9818    | 0.9888 |
| 0.1086        | 83.9762 | 861  | 0.0864          | 0.9694   | 0.9708            | 0.9694         | 0.9684     | 0.9577       | 0.7158    | 0.8193 | 0.8901       | 0.9843    | 0.9348 | 0.9929       | 0.9899    | 0.9914 |
| 0.1108        | 84.9524 | 871  | 0.0808          | 0.9634   | 0.9646            | 0.9634         | 0.9630     | 0.8974       | 0.7368    | 0.8092 | 0.8723       | 0.9647    | 0.9162 | 0.9949       | 0.9848    | 0.9898 |
| 0.1017        | 85.9286 | 881  | 0.0825          | 0.9686   | 0.9704            | 0.9686         | 0.9677     | 0.9577       | 0.7158    | 0.8193 | 0.8838       | 0.9843    | 0.9314 | 0.9939       | 0.9889    | 0.9914 |
| 0.1108        | 86.9048 | 891  | 0.0800          | 0.9694   | 0.9700            | 0.9694         | 0.9688     | 0.9221       | 0.7474    | 0.8256 | 0.8953       | 0.9725    | 0.9323 | 0.9939       | 0.9899    | 0.9919 |
| 0.1081        | 87.9762 | 902  | 0.0867          | 0.9679   | 0.9702            | 0.9679         | 0.9669     | 0.9710       | 0.7053    | 0.8171 | 0.8780       | 0.9882    | 0.9299 | 0.9939       | 0.9879    | 0.9909 |
| 0.1076        | 88.9524 | 912  | 0.0789          | 0.9716   | 0.9720            | 0.9716         | 0.9708     | 0.9333       | 0.7368    | 0.8235 | 0.9055       | 0.9765    | 0.9396 | 0.9929       | 0.9929    | 0.9929 |
| 0.1059        | 89.9286 | 922  | 0.0829          | 0.9694   | 0.9708            | 0.9694         | 0.9685     | 0.9583       | 0.7263    | 0.8263 | 0.8897       | 0.9804    | 0.9328 | 0.9929       | 0.9899    | 0.9914 |
| 0.1048        | 90.9048 | 932  | 0.0771          | 0.9716   | 0.9718            | 0.9716         | 0.9709     | 0.9221       | 0.7474    | 0.8256 | 0.9084       | 0.9725    | 0.9394 | 0.9929       | 0.9929    | 0.9929 |
| 0.098         | 91.9762 | 943  | 0.0796          | 0.9709   | 0.9715            | 0.9709         | 0.9701     | 0.9333       | 0.7368    | 0.8235 | 0.8986       | 0.9725    | 0.9341 | 0.9939       | 0.9929    | 0.9934 |
| 0.1075        | 92.9524 | 953  | 0.0798          | 0.9679   | 0.9689            | 0.9679         | 0.9673     | 0.9211       | 0.7368    | 0.8187 | 0.8857       | 0.9725    | 0.9271 | 0.9949       | 0.9889    | 0.9919 |
| 0.0937        | 93.9286 | 963  | 0.0777          | 0.9701   | 0.9709            | 0.9701         | 0.9694     | 0.9333       | 0.7368    | 0.8235 | 0.8957       | 0.9765    | 0.9343 | 0.9939       | 0.9909    | 0.9924 |
| 0.1099        | 94.9048 | 973  | 0.0760          | 0.9679   | 0.9685            | 0.9679         | 0.9673     | 0.9103       | 0.7474    | 0.8208 | 0.8917       | 0.9686    | 0.9286 | 0.9939       | 0.9889    | 0.9914 |
| 0.1043        | 95.9762 | 984  | 0.0763          | 0.9701   | 0.9710            | 0.9701         | 0.9695     | 0.9342       | 0.7474    | 0.8304 | 0.8957       | 0.9765    | 0.9343 | 0.9939       | 0.9899    | 0.9919 |
| 0.1013        | 96.9524 | 994  | 0.0774          | 0.9686   | 0.9697            | 0.9686         | 0.9679     | 0.9333       | 0.7368    | 0.8235 | 0.8893       | 0.9765    | 0.9308 | 0.9939       | 0.9889    | 0.9914 |
| 0.1097        | 97.5476 | 1000 | 0.0776          | 0.9686   | 0.9697            | 0.9686         | 0.9679     | 0.9333       | 0.7368    | 0.8235 | 0.8893       | 0.9765    | 0.9308 | 0.9939       | 0.9889    | 0.9914 |


### Framework versions

- Transformers 4.46.3
- Pytorch 2.4.1+cu121
- Datasets 3.1.0
- Tokenizers 0.20.3

t0 t1 t2