
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# vit-base_tobacco_bs_16_lr_1e-5_e_200_wr_0.05_wd_0.4_split

This model is a fine-tuned version of [jordyvl/vit-base_tobacco](https://huggingface.co/jordyvl/vit-base_tobacco) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.0411
- Accuracy: 0.8333
- Brier Loss: 0.3084
- Nll: 1.3568
- F1 Micro: 0.8333
- F1 Macro: 0.8183
- Ece: 0.1563
- Aurc: 0.0847

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- gradient_accumulation_steps: 16
- total_train_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.05
- num_epochs: 200

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Accuracy | Brier Loss | Nll    | F1 Micro | F1 Macro | Ece    | Aurc   |
|:-------------:|:------:|:----:|:---------------:|:--------:|:----------:|:------:|:--------:|:--------:|:------:|:------:|
| No log        | 0.99   | 43   | 0.7544          | 0.7960   | 0.3088     | 1.3391 | 0.7960   | 0.7715   | 0.1991 | 0.0817 |
| No log        | 2.0    | 87   | 0.7158          | 0.8218   | 0.2920     | 1.1888 | 0.8218   | 0.7941   | 0.1863 | 0.0741 |
| No log        | 2.98   | 130  | 0.7144          | 0.7989   | 0.2932     | 1.2958 | 0.7989   | 0.7701   | 0.1628 | 0.0749 |
| No log        | 3.99   | 174  | 0.6762          | 0.8305   | 0.2749     | 1.1916 | 0.8305   | 0.8076   | 0.1844 | 0.0678 |
| No log        | 4.98   | 217  | 0.6710          | 0.8362   | 0.2745     | 1.0739 | 0.8362   | 0.8076   | 0.1696 | 0.0664 |
| No log        | 5.99   | 261  | 0.6532          | 0.8362   | 0.2675     | 1.0011 | 0.8362   | 0.8115   | 0.1750 | 0.0602 |
| No log        | 6.98   | 304  | 0.6404          | 0.8362   | 0.2635     | 1.0072 | 0.8362   | 0.8106   | 0.1714 | 0.0633 |
| No log        | 7.99   | 348  | 0.6635          | 0.8218   | 0.2707     | 1.0903 | 0.8218   | 0.8030   | 0.1513 | 0.0770 |
| No log        | 9.0    | 392  | 0.6167          | 0.8420   | 0.2534     | 1.0176 | 0.8420   | 0.8259   | 0.1613 | 0.0796 |
| No log        | 9.99   | 435  | 0.6496          | 0.8276   | 0.2703     | 0.9646 | 0.8276   | 0.8085   | 0.1643 | 0.0588 |
| No log        | 11.0   | 479  | 0.6091          | 0.8506   | 0.2467     | 1.1036 | 0.8506   | 0.8308   | 0.1483 | 0.0650 |
| 0.4309        | 11.98  | 522  | 0.6075          | 0.8420   | 0.2483     | 0.9144 | 0.8420   | 0.8246   | 0.1391 | 0.0519 |
| 0.4309        | 12.99  | 566  | 0.6164          | 0.8276   | 0.2576     | 0.9703 | 0.8276   | 0.8092   | 0.1467 | 0.0645 |
| 0.4309        | 13.98  | 609  | 0.5893          | 0.8592   | 0.2347     | 1.1493 | 0.8592   | 0.8483   | 0.1347 | 0.0715 |
| 0.4309        | 14.99  | 653  | 0.6123          | 0.8477   | 0.2485     | 1.1889 | 0.8477   | 0.8232   | 0.1587 | 0.0764 |
| 0.4309        | 16.0   | 697  | 0.6352          | 0.8420   | 0.2615     | 1.1999 | 0.8420   | 0.8403   | 0.1368 | 0.0668 |
| 0.4309        | 16.99  | 740  | 0.6329          | 0.8333   | 0.2625     | 1.1748 | 0.8333   | 0.8249   | 0.1267 | 0.0744 |
| 0.4309        | 18.0   | 784  | 0.6350          | 0.8448   | 0.2590     | 1.2154 | 0.8448   | 0.8386   | 0.1423 | 0.0688 |
| 0.4309        | 18.98  | 827  | 0.5892          | 0.8592   | 0.2383     | 1.1001 | 0.8592   | 0.8515   | 0.1293 | 0.0630 |
| 0.4309        | 19.99  | 871  | 0.5981          | 0.8477   | 0.2476     | 1.0104 | 0.8477   | 0.8375   | 0.1345 | 0.0630 |
| 0.4309        | 20.98  | 914  | 0.6484          | 0.8420   | 0.2642     | 1.3553 | 0.8420   | 0.8292   | 0.1490 | 0.0770 |
| 0.4309        | 21.99  | 958  | 0.6298          | 0.8305   | 0.2657     | 1.1220 | 0.8305   | 0.8208   | 0.1292 | 0.0670 |
| 0.1285        | 22.98  | 1001 | 0.6325          | 0.8391   | 0.2633     | 1.2549 | 0.8391   | 0.8362   | 0.1328 | 0.0708 |
| 0.1285        | 23.99  | 1045 | 0.6032          | 0.8534   | 0.2486     | 1.1258 | 0.8534   | 0.8444   | 0.1229 | 0.0706 |
| 0.1285        | 25.0   | 1089 | 0.6080          | 0.8534   | 0.2460     | 1.2033 | 0.8534   | 0.8414   | 0.1257 | 0.0755 |
| 0.1285        | 25.99  | 1132 | 0.6321          | 0.8391   | 0.2667     | 1.2242 | 0.8391   | 0.8355   | 0.1349 | 0.0697 |
| 0.1285        | 27.0   | 1176 | 0.6325          | 0.8592   | 0.2522     | 1.2029 | 0.8592   | 0.8493   | 0.1278 | 0.0778 |
| 0.1285        | 27.98  | 1219 | 0.6585          | 0.8534   | 0.2546     | 1.3669 | 0.8534   | 0.8378   | 0.1368 | 0.0890 |
| 0.1285        | 28.99  | 1263 | 0.6302          | 0.8563   | 0.2517     | 1.2419 | 0.8563   | 0.8508   | 0.1294 | 0.0751 |
| 0.1285        | 29.98  | 1306 | 0.6663          | 0.8477   | 0.2637     | 1.4132 | 0.8477   | 0.8339   | 0.1399 | 0.0828 |
| 0.1285        | 30.99  | 1350 | 0.7063          | 0.8362   | 0.2799     | 1.4323 | 0.8362   | 0.8330   | 0.1441 | 0.0863 |
| 0.1285        | 32.0   | 1394 | 0.6564          | 0.8506   | 0.2570     | 1.1583 | 0.8506   | 0.8417   | 0.1358 | 0.0847 |
| 0.1285        | 32.99  | 1437 | 0.6738          | 0.8477   | 0.2647     | 1.3855 | 0.8477   | 0.8398   | 0.1305 | 0.0775 |
| 0.1285        | 34.0   | 1481 | 0.6528          | 0.8563   | 0.2559     | 1.2601 | 0.8563   | 0.8462   | 0.1310 | 0.0789 |
| 0.0385        | 34.98  | 1524 | 0.6534          | 0.8563   | 0.2537     | 1.2931 | 0.8563   | 0.8461   | 0.1241 | 0.0773 |
| 0.0385        | 35.99  | 1568 | 0.6541          | 0.8534   | 0.2525     | 1.2589 | 0.8534   | 0.8449   | 0.1315 | 0.0833 |
| 0.0385        | 36.98  | 1611 | 0.6769          | 0.8592   | 0.2545     | 1.4351 | 0.8592   | 0.8492   | 0.1242 | 0.0792 |
| 0.0385        | 37.99  | 1655 | 0.6824          | 0.8592   | 0.2576     | 1.2241 | 0.8592   | 0.8472   | 0.1327 | 0.0810 |
| 0.0385        | 38.98  | 1698 | 0.6843          | 0.8563   | 0.2589     | 1.3394 | 0.8563   | 0.8450   | 0.1311 | 0.0802 |
| 0.0385        | 39.99  | 1742 | 0.6964          | 0.8506   | 0.2630     | 1.2625 | 0.8506   | 0.8405   | 0.1310 | 0.0789 |
| 0.0385        | 41.0   | 1786 | 0.7051          | 0.8534   | 0.2671     | 1.3296 | 0.8534   | 0.8434   | 0.1353 | 0.0794 |
| 0.0385        | 41.99  | 1829 | 0.7006          | 0.8506   | 0.2645     | 1.2965 | 0.8506   | 0.8400   | 0.1373 | 0.0796 |
| 0.0385        | 43.0   | 1873 | 0.7054          | 0.8563   | 0.2646     | 1.2973 | 0.8563   | 0.8450   | 0.1313 | 0.0790 |
| 0.0385        | 43.98  | 1916 | 0.7143          | 0.8506   | 0.2673     | 1.2640 | 0.8506   | 0.8399   | 0.1359 | 0.0803 |
| 0.0385        | 44.99  | 1960 | 0.7168          | 0.8534   | 0.2665     | 1.3058 | 0.8534   | 0.8429   | 0.1389 | 0.0820 |
| 0.0206        | 45.98  | 2003 | 0.7204          | 0.8506   | 0.2669     | 1.3009 | 0.8506   | 0.8384   | 0.1336 | 0.0805 |
| 0.0206        | 46.99  | 2047 | 0.7265          | 0.8534   | 0.2683     | 1.2633 | 0.8534   | 0.8415   | 0.1319 | 0.0806 |
| 0.0206        | 48.0   | 2091 | 0.7311          | 0.8506   | 0.2695     | 1.2725 | 0.8506   | 0.8396   | 0.1372 | 0.0811 |
| 0.0206        | 48.99  | 2134 | 0.7384          | 0.8477   | 0.2729     | 1.3385 | 0.8477   | 0.8364   | 0.1387 | 0.0807 |
| 0.0206        | 50.0   | 2178 | 0.7383          | 0.8534   | 0.2695     | 1.1951 | 0.8534   | 0.8406   | 0.1344 | 0.0827 |
| 0.0206        | 50.98  | 2221 | 0.7440          | 0.8506   | 0.2740     | 1.3360 | 0.8506   | 0.8394   | 0.1418 | 0.0812 |
| 0.0206        | 51.99  | 2265 | 0.7455          | 0.8506   | 0.2727     | 1.2704 | 0.8506   | 0.8388   | 0.1351 | 0.0816 |
| 0.0206        | 52.98  | 2308 | 0.7474          | 0.8506   | 0.2708     | 1.2622 | 0.8506   | 0.8384   | 0.1334 | 0.0823 |
| 0.0206        | 53.99  | 2352 | 0.7581          | 0.8477   | 0.2750     | 1.3446 | 0.8477   | 0.8374   | 0.1406 | 0.0826 |
| 0.0206        | 54.98  | 2395 | 0.7571          | 0.8477   | 0.2751     | 1.3703 | 0.8477   | 0.8363   | 0.1378 | 0.0814 |
| 0.0206        | 55.99  | 2439 | 0.7618          | 0.8477   | 0.2752     | 1.3702 | 0.8477   | 0.8363   | 0.1363 | 0.0827 |
| 0.0206        | 57.0   | 2483 | 0.7638          | 0.8477   | 0.2749     | 1.3774 | 0.8477   | 0.8363   | 0.1394 | 0.0819 |
| 0.0135        | 57.99  | 2526 | 0.7693          | 0.8477   | 0.2760     | 1.3370 | 0.8477   | 0.8363   | 0.1378 | 0.0824 |
| 0.0135        | 59.0   | 2570 | 0.7724          | 0.8448   | 0.2779     | 1.3710 | 0.8448   | 0.8344   | 0.1431 | 0.0823 |
| 0.0135        | 59.98  | 2613 | 0.7780          | 0.8477   | 0.2784     | 1.3328 | 0.8477   | 0.8363   | 0.1463 | 0.0828 |
| 0.0135        | 60.99  | 2657 | 0.7818          | 0.8477   | 0.2795     | 1.3289 | 0.8477   | 0.8363   | 0.1466 | 0.0828 |
| 0.0135        | 61.98  | 2700 | 0.7847          | 0.8420   | 0.2805     | 1.3308 | 0.8420   | 0.8308   | 0.1418 | 0.0830 |
| 0.0135        | 62.99  | 2744 | 0.7851          | 0.8448   | 0.2782     | 1.3650 | 0.8448   | 0.8344   | 0.1411 | 0.0834 |
| 0.0135        | 64.0   | 2788 | 0.7925          | 0.8420   | 0.2829     | 1.4383 | 0.8420   | 0.8319   | 0.1425 | 0.0821 |
| 0.0135        | 64.99  | 2831 | 0.7959          | 0.8448   | 0.2826     | 1.4130 | 0.8448   | 0.8353   | 0.1431 | 0.0826 |
| 0.0135        | 66.0   | 2875 | 0.7989          | 0.8420   | 0.2821     | 1.4040 | 0.8420   | 0.8285   | 0.1446 | 0.0833 |
| 0.0135        | 66.98  | 2918 | 0.7996          | 0.8477   | 0.2807     | 1.3296 | 0.8477   | 0.8363   | 0.1464 | 0.0837 |
| 0.0135        | 67.99  | 2962 | 0.8042          | 0.8448   | 0.2824     | 1.3637 | 0.8448   | 0.8344   | 0.1434 | 0.0837 |
| 0.0097        | 68.98  | 3005 | 0.8095          | 0.8391   | 0.2845     | 1.3635 | 0.8391   | 0.8275   | 0.1468 | 0.0835 |
| 0.0097        | 69.99  | 3049 | 0.8073          | 0.8448   | 0.2824     | 1.3640 | 0.8448   | 0.8344   | 0.1413 | 0.0833 |
| 0.0097        | 70.98  | 3092 | 0.8140          | 0.8477   | 0.2834     | 1.3617 | 0.8477   | 0.8363   | 0.1444 | 0.0837 |
| 0.0097        | 71.99  | 3136 | 0.8152          | 0.8420   | 0.2842     | 1.4009 | 0.8420   | 0.8277   | 0.1439 | 0.0840 |
| 0.0097        | 73.0   | 3180 | 0.8163          | 0.8391   | 0.2858     | 1.4029 | 0.8391   | 0.8246   | 0.1482 | 0.0836 |
| 0.0097        | 73.99  | 3223 | 0.8192          | 0.8391   | 0.2844     | 1.3644 | 0.8391   | 0.8240   | 0.1475 | 0.0843 |
| 0.0097        | 75.0   | 3267 | 0.8225          | 0.8448   | 0.2836     | 1.3593 | 0.8448   | 0.8344   | 0.1473 | 0.0847 |
| 0.0097        | 75.98  | 3310 | 0.8267          | 0.8362   | 0.2859     | 1.3642 | 0.8362   | 0.8207   | 0.1473 | 0.0840 |
| 0.0097        | 76.99  | 3354 | 0.8275          | 0.8391   | 0.2847     | 1.3618 | 0.8391   | 0.8240   | 0.1450 | 0.0849 |
| 0.0097        | 77.98  | 3397 | 0.8325          | 0.8362   | 0.2879     | 1.3686 | 0.8362   | 0.8207   | 0.1491 | 0.0843 |
| 0.0097        | 78.99  | 3441 | 0.8389          | 0.8448   | 0.2885     | 1.3629 | 0.8448   | 0.8329   | 0.1504 | 0.0833 |
| 0.0097        | 80.0   | 3485 | 0.8420          | 0.8420   | 0.2887     | 1.3610 | 0.8420   | 0.8261   | 0.1458 | 0.0837 |
| 0.0073        | 80.99  | 3528 | 0.8452          | 0.8362   | 0.2900     | 1.4064 | 0.8362   | 0.8221   | 0.1488 | 0.0833 |
| 0.0073        | 82.0   | 3572 | 0.8492          | 0.8362   | 0.2898     | 1.4076 | 0.8362   | 0.8221   | 0.1500 | 0.0837 |
| 0.0073        | 82.98  | 3615 | 0.8478          | 0.8362   | 0.2895     | 1.3609 | 0.8362   | 0.8207   | 0.1485 | 0.0847 |
| 0.0073        | 83.99  | 3659 | 0.8483          | 0.8391   | 0.2880     | 1.3622 | 0.8391   | 0.8243   | 0.1480 | 0.0842 |
| 0.0073        | 84.98  | 3702 | 0.8534          | 0.8420   | 0.2892     | 1.3609 | 0.8420   | 0.8261   | 0.1468 | 0.0843 |
| 0.0073        | 85.99  | 3746 | 0.8547          | 0.8333   | 0.2898     | 1.4028 | 0.8333   | 0.8186   | 0.1513 | 0.0846 |
| 0.0073        | 86.98  | 3789 | 0.8618          | 0.8391   | 0.2906     | 1.3597 | 0.8391   | 0.8243   | 0.1445 | 0.0846 |
| 0.0073        | 87.99  | 3833 | 0.8594          | 0.8420   | 0.2885     | 1.3265 | 0.8420   | 0.8311   | 0.1462 | 0.0848 |
| 0.0073        | 89.0   | 3877 | 0.8669          | 0.8391   | 0.2911     | 1.3592 | 0.8391   | 0.8243   | 0.1471 | 0.0843 |
| 0.0073        | 89.99  | 3920 | 0.8664          | 0.8391   | 0.2901     | 1.3597 | 0.8391   | 0.8243   | 0.1468 | 0.0852 |
| 0.0073        | 91.0   | 3964 | 0.8678          | 0.8420   | 0.2905     | 1.3253 | 0.8420   | 0.8296   | 0.1462 | 0.0854 |
| 0.0057        | 91.98  | 4007 | 0.8719          | 0.8391   | 0.2909     | 1.3585 | 0.8391   | 0.8243   | 0.1475 | 0.0853 |
| 0.0057        | 92.99  | 4051 | 0.8768          | 0.8391   | 0.2930     | 1.3595 | 0.8391   | 0.8243   | 0.1493 | 0.0852 |
| 0.0057        | 93.98  | 4094 | 0.8785          | 0.8333   | 0.2928     | 1.4034 | 0.8333   | 0.8203   | 0.1529 | 0.0849 |
| 0.0057        | 94.99  | 4138 | 0.8859          | 0.8333   | 0.2942     | 1.3684 | 0.8333   | 0.8183   | 0.1543 | 0.0844 |
| 0.0057        | 96.0   | 4182 | 0.8839          | 0.8362   | 0.2937     | 1.3597 | 0.8362   | 0.8221   | 0.1497 | 0.0852 |
| 0.0057        | 96.99  | 4225 | 0.8864          | 0.8333   | 0.2940     | 1.4012 | 0.8333   | 0.8203   | 0.1532 | 0.0850 |
| 0.0057        | 98.0   | 4269 | 0.8879          | 0.8362   | 0.2941     | 1.3607 | 0.8362   | 0.8221   | 0.1504 | 0.0849 |
| 0.0057        | 98.98  | 4312 | 0.8921          | 0.8333   | 0.2954     | 1.3609 | 0.8333   | 0.8183   | 0.1521 | 0.0851 |
| 0.0057        | 99.99  | 4356 | 0.8949          | 0.8391   | 0.2945     | 1.3575 | 0.8391   | 0.8243   | 0.1491 | 0.0854 |
| 0.0057        | 100.98 | 4399 | 0.8945          | 0.8362   | 0.2945     | 1.3591 | 0.8362   | 0.8221   | 0.1500 | 0.0856 |
| 0.0057        | 101.99 | 4443 | 0.8985          | 0.8333   | 0.2944     | 1.3599 | 0.8333   | 0.8183   | 0.1530 | 0.0854 |
| 0.0057        | 102.98 | 4486 | 0.8987          | 0.8391   | 0.2951     | 1.3586 | 0.8391   | 0.8246   | 0.1499 | 0.0850 |
| 0.0045        | 103.99 | 4530 | 0.9025          | 0.8362   | 0.2957     | 1.3592 | 0.8362   | 0.8221   | 0.1510 | 0.0857 |
| 0.0045        | 105.0  | 4574 | 0.9082          | 0.8305   | 0.2972     | 1.3625 | 0.8305   | 0.8165   | 0.1568 | 0.0852 |
| 0.0045        | 105.99 | 4617 | 0.9087          | 0.8362   | 0.2958     | 1.3579 | 0.8362   | 0.8221   | 0.1505 | 0.0858 |
| 0.0045        | 107.0  | 4661 | 0.9105          | 0.8305   | 0.2977     | 1.3619 | 0.8305   | 0.8165   | 0.1561 | 0.0844 |
| 0.0045        | 107.98 | 4704 | 0.9136          | 0.8305   | 0.2978     | 1.3994 | 0.8305   | 0.8165   | 0.1559 | 0.0851 |
| 0.0045        | 108.99 | 4748 | 0.9148          | 0.8391   | 0.2968     | 1.3573 | 0.8391   | 0.8243   | 0.1504 | 0.0856 |
| 0.0045        | 109.98 | 4791 | 0.9188          | 0.8333   | 0.2974     | 1.3569 | 0.8333   | 0.8183   | 0.1532 | 0.0850 |
| 0.0045        | 110.99 | 4835 | 0.9164          | 0.8362   | 0.2959     | 1.3595 | 0.8362   | 0.8221   | 0.1507 | 0.0857 |
| 0.0045        | 112.0  | 4879 | 0.9221          | 0.8333   | 0.2977     | 1.3573 | 0.8333   | 0.8183   | 0.1550 | 0.0857 |
| 0.0045        | 112.99 | 4922 | 0.9256          | 0.8305   | 0.2990     | 1.3599 | 0.8305   | 0.8165   | 0.1574 | 0.0852 |
| 0.0045        | 114.0  | 4966 | 0.9284          | 0.8305   | 0.2994     | 1.3610 | 0.8305   | 0.8165   | 0.1572 | 0.0848 |
| 0.0037        | 114.98 | 5009 | 0.9312          | 0.8333   | 0.2998     | 1.3565 | 0.8333   | 0.8183   | 0.1537 | 0.0857 |
| 0.0037        | 115.99 | 5053 | 0.9322          | 0.8333   | 0.2995     | 1.3583 | 0.8333   | 0.8183   | 0.1543 | 0.0852 |
| 0.0037        | 116.98 | 5096 | 0.9385          | 0.8305   | 0.3007     | 1.3593 | 0.8305   | 0.8165   | 0.1577 | 0.0852 |
| 0.0037        | 117.99 | 5140 | 0.9386          | 0.8305   | 0.3009     | 1.4329 | 0.8305   | 0.8165   | 0.1582 | 0.0851 |
| 0.0037        | 118.98 | 5183 | 0.9386          | 0.8333   | 0.2996     | 1.3570 | 0.8333   | 0.8183   | 0.1542 | 0.0855 |
| 0.0037        | 119.99 | 5227 | 0.9406          | 0.8333   | 0.2995     | 1.3554 | 0.8333   | 0.8183   | 0.1540 | 0.0848 |
| 0.0037        | 121.0  | 5271 | 0.9442          | 0.8305   | 0.3006     | 1.3589 | 0.8305   | 0.8165   | 0.1570 | 0.0849 |
| 0.0037        | 121.99 | 5314 | 0.9435          | 0.8333   | 0.3000     | 1.3551 | 0.8333   | 0.8183   | 0.1546 | 0.0855 |
| 0.0037        | 123.0  | 5358 | 0.9456          | 0.8333   | 0.2996     | 1.3550 | 0.8333   | 0.8183   | 0.1544 | 0.0848 |
| 0.0037        | 123.98 | 5401 | 0.9490          | 0.8333   | 0.3008     | 1.3561 | 0.8333   | 0.8183   | 0.1547 | 0.0850 |
| 0.0037        | 124.99 | 5445 | 0.9500          | 0.8333   | 0.3011     | 1.3592 | 0.8333   | 0.8183   | 0.1551 | 0.0846 |
| 0.0037        | 125.98 | 5488 | 0.9513          | 0.8333   | 0.3003     | 1.3549 | 0.8333   | 0.8183   | 0.1544 | 0.0845 |
| 0.0031        | 126.99 | 5532 | 0.9575          | 0.8305   | 0.3024     | 1.3580 | 0.8305   | 0.8165   | 0.1581 | 0.0849 |
| 0.0031        | 128.0  | 5576 | 0.9593          | 0.8305   | 0.3025     | 1.4028 | 0.8305   | 0.8165   | 0.1591 | 0.0851 |
| 0.0031        | 128.99 | 5619 | 0.9594          | 0.8305   | 0.3021     | 1.3619 | 0.8305   | 0.8165   | 0.1579 | 0.0849 |
| 0.0031        | 130.0  | 5663 | 0.9628          | 0.8305   | 0.3025     | 1.3589 | 0.8305   | 0.8165   | 0.1587 | 0.0847 |
| 0.0031        | 130.98 | 5706 | 0.9652          | 0.8305   | 0.3031     | 1.3599 | 0.8305   | 0.8165   | 0.1593 | 0.0844 |
| 0.0031        | 131.99 | 5750 | 0.9646          | 0.8362   | 0.3005     | 1.3353 | 0.8362   | 0.8205   | 0.1520 | 0.0851 |
| 0.0031        | 132.98 | 5793 | 0.9658          | 0.8333   | 0.3021     | 1.3562 | 0.8333   | 0.8183   | 0.1555 | 0.0849 |
| 0.0031        | 133.99 | 5837 | 0.9698          | 0.8333   | 0.3023     | 1.3545 | 0.8333   | 0.8183   | 0.1554 | 0.0845 |
| 0.0031        | 134.98 | 5880 | 0.9716          | 0.8333   | 0.3032     | 1.3559 | 0.8333   | 0.8183   | 0.1555 | 0.0852 |
| 0.0031        | 135.99 | 5924 | 0.9736          | 0.8305   | 0.3037     | 1.3624 | 0.8305   | 0.8165   | 0.1584 | 0.0849 |
| 0.0031        | 137.0  | 5968 | 0.9760          | 0.8333   | 0.3039     | 1.3575 | 0.8333   | 0.8183   | 0.1551 | 0.0845 |
| 0.0026        | 137.99 | 6011 | 0.9789          | 0.8305   | 0.3041     | 1.3569 | 0.8305   | 0.8165   | 0.1592 | 0.0848 |
| 0.0026        | 139.0  | 6055 | 0.9801          | 0.8305   | 0.3040     | 1.3574 | 0.8305   | 0.8165   | 0.1598 | 0.0854 |
| 0.0026        | 139.98 | 6098 | 0.9806          | 0.8333   | 0.3035     | 1.3552 | 0.8333   | 0.8183   | 0.1557 | 0.0852 |
| 0.0026        | 140.99 | 6142 | 0.9835          | 0.8333   | 0.3041     | 1.3574 | 0.8333   | 0.8183   | 0.1564 | 0.0846 |
| 0.0026        | 141.98 | 6185 | 0.9838          | 0.8333   | 0.3037     | 1.3549 | 0.8333   | 0.8183   | 0.1557 | 0.0849 |
| 0.0026        | 142.99 | 6229 | 0.9872          | 0.8333   | 0.3044     | 1.3544 | 0.8333   | 0.8183   | 0.1557 | 0.0851 |
| 0.0026        | 144.0  | 6273 | 0.9900          | 0.8305   | 0.3056     | 1.3654 | 0.8305   | 0.8165   | 0.1597 | 0.0847 |
| 0.0026        | 144.99 | 6316 | 0.9907          | 0.8333   | 0.3049     | 1.3551 | 0.8333   | 0.8183   | 0.1565 | 0.0854 |
| 0.0026        | 146.0  | 6360 | 0.9896          | 0.8333   | 0.3044     | 1.3569 | 0.8333   | 0.8183   | 0.1563 | 0.0843 |
| 0.0026        | 146.98 | 6403 | 0.9938          | 0.8333   | 0.3053     | 1.3550 | 0.8333   | 0.8183   | 0.1562 | 0.0844 |
| 0.0026        | 147.99 | 6447 | 0.9962          | 0.8305   | 0.3056     | 1.3615 | 0.8305   | 0.8165   | 0.1594 | 0.0844 |
| 0.0026        | 148.98 | 6490 | 0.9954          | 0.8305   | 0.3051     | 1.3601 | 0.8305   | 0.8165   | 0.1590 | 0.0847 |
| 0.0022        | 149.99 | 6534 | 0.9961          | 0.8333   | 0.3043     | 1.3550 | 0.8333   | 0.8183   | 0.1554 | 0.0847 |
| 0.0022        | 150.98 | 6577 | 1.0026          | 0.8333   | 0.3059     | 1.3555 | 0.8333   | 0.8183   | 0.1563 | 0.0853 |
| 0.0022        | 151.99 | 6621 | 1.0004          | 0.8333   | 0.3049     | 1.3544 | 0.8333   | 0.8183   | 0.1566 | 0.0847 |
| 0.0022        | 153.0  | 6665 | 1.0024          | 0.8305   | 0.3058     | 1.3606 | 0.8305   | 0.8165   | 0.1595 | 0.0846 |
| 0.0022        | 153.99 | 6708 | 1.0054          | 0.8305   | 0.3064     | 1.3598 | 0.8305   | 0.8165   | 0.1591 | 0.0848 |
| 0.0022        | 155.0  | 6752 | 1.0053          | 0.8333   | 0.3054     | 1.3548 | 0.8333   | 0.8183   | 0.1562 | 0.0845 |
| 0.0022        | 155.98 | 6795 | 1.0068          | 0.8333   | 0.3053     | 1.3548 | 0.8333   | 0.8183   | 0.1562 | 0.0846 |
| 0.0022        | 156.99 | 6839 | 1.0076          | 0.8333   | 0.3055     | 1.3551 | 0.8333   | 0.8183   | 0.1561 | 0.0844 |
| 0.0022        | 157.98 | 6882 | 1.0105          | 0.8333   | 0.3059     | 1.3546 | 0.8333   | 0.8183   | 0.1563 | 0.0845 |
| 0.0022        | 158.99 | 6926 | 1.0114          | 0.8333   | 0.3061     | 1.3555 | 0.8333   | 0.8183   | 0.1559 | 0.0851 |
| 0.0022        | 160.0  | 6970 | 1.0108          | 0.8333   | 0.3061     | 1.3586 | 0.8333   | 0.8183   | 0.1561 | 0.0848 |
| 0.002         | 160.99 | 7013 | 1.0129          | 0.8333   | 0.3064     | 1.3577 | 0.8333   | 0.8183   | 0.1560 | 0.0845 |
| 0.002         | 162.0  | 7057 | 1.0141          | 0.8333   | 0.3060     | 1.3542 | 0.8333   | 0.8183   | 0.1562 | 0.0845 |
| 0.002         | 162.98 | 7100 | 1.0150          | 0.8333   | 0.3063     | 1.3555 | 0.8333   | 0.8183   | 0.1563 | 0.0847 |
| 0.002         | 163.99 | 7144 | 1.0181          | 0.8305   | 0.3071     | 1.3616 | 0.8305   | 0.8165   | 0.1587 | 0.0847 |
| 0.002         | 164.98 | 7187 | 1.0197          | 0.8305   | 0.3073     | 1.3610 | 0.8305   | 0.8165   | 0.1585 | 0.0847 |
| 0.002         | 165.99 | 7231 | 1.0203          | 0.8333   | 0.3071     | 1.3566 | 0.8333   | 0.8183   | 0.1565 | 0.0846 |
| 0.002         | 166.98 | 7274 | 1.0214          | 0.8333   | 0.3070     | 1.3561 | 0.8333   | 0.8183   | 0.1564 | 0.0845 |
| 0.002         | 167.99 | 7318 | 1.0211          | 0.8333   | 0.3067     | 1.3558 | 0.8333   | 0.8183   | 0.1562 | 0.0846 |
| 0.002         | 169.0  | 7362 | 1.0255          | 0.8305   | 0.3077     | 1.3564 | 0.8305   | 0.8165   | 0.1592 | 0.0846 |
| 0.002         | 169.99 | 7405 | 1.0238          | 0.8333   | 0.3066     | 1.3535 | 0.8333   | 0.8183   | 0.1567 | 0.0844 |
| 0.002         | 171.0  | 7449 | 1.0258          | 0.8333   | 0.3075     | 1.3580 | 0.8333   | 0.8183   | 0.1562 | 0.0847 |
| 0.002         | 171.98 | 7492 | 1.0260          | 0.8333   | 0.3073     | 1.3594 | 0.8333   | 0.8183   | 0.1559 | 0.0846 |
| 0.0018        | 172.99 | 7536 | 1.0281          | 0.8305   | 0.3077     | 1.3584 | 0.8305   | 0.8165   | 0.1586 | 0.0847 |
| 0.0018        | 173.98 | 7579 | 1.0274          | 0.8333   | 0.3073     | 1.3577 | 0.8333   | 0.8183   | 0.1560 | 0.0851 |
| 0.0018        | 174.99 | 7623 | 1.0323          | 0.8305   | 0.3082     | 1.3577 | 0.8305   | 0.8165   | 0.1596 | 0.0848 |
| 0.0018        | 176.0  | 7667 | 1.0303          | 0.8333   | 0.3076     | 1.3579 | 0.8333   | 0.8183   | 0.1561 | 0.0846 |
| 0.0018        | 176.99 | 7710 | 1.0325          | 0.8333   | 0.3081     | 1.3567 | 0.8333   | 0.8183   | 0.1565 | 0.0845 |
| 0.0018        | 178.0  | 7754 | 1.0319          | 0.8333   | 0.3077     | 1.3569 | 0.8333   | 0.8183   | 0.1560 | 0.0847 |
| 0.0018        | 178.98 | 7797 | 1.0340          | 0.8333   | 0.3081     | 1.3568 | 0.8333   | 0.8183   | 0.1562 | 0.0847 |
| 0.0018        | 179.99 | 7841 | 1.0331          | 0.8333   | 0.3072     | 1.3550 | 0.8333   | 0.8183   | 0.1564 | 0.0847 |
| 0.0018        | 180.98 | 7884 | 1.0346          | 0.8333   | 0.3079     | 1.3563 | 0.8333   | 0.8183   | 0.1561 | 0.0847 |
| 0.0018        | 181.99 | 7928 | 1.0344          | 0.8333   | 0.3079     | 1.3577 | 0.8333   | 0.8183   | 0.1565 | 0.0847 |
| 0.0018        | 182.98 | 7971 | 1.0363          | 0.8333   | 0.3080     | 1.3556 | 0.8333   | 0.8183   | 0.1566 | 0.0850 |
| 0.0016        | 183.99 | 8015 | 1.0368          | 0.8333   | 0.3080     | 1.3569 | 0.8333   | 0.8183   | 0.1561 | 0.0847 |
| 0.0016        | 185.0  | 8059 | 1.0369          | 0.8333   | 0.3080     | 1.3563 | 0.8333   | 0.8183   | 0.1562 | 0.0847 |
| 0.0016        | 185.99 | 8102 | 1.0373          | 0.8333   | 0.3080     | 1.3565 | 0.8333   | 0.8183   | 0.1561 | 0.0850 |
| 0.0016        | 187.0  | 8146 | 1.0377          | 0.8333   | 0.3080     | 1.3568 | 0.8333   | 0.8183   | 0.1561 | 0.0846 |
| 0.0016        | 187.98 | 8189 | 1.0392          | 0.8333   | 0.3084     | 1.3577 | 0.8333   | 0.8183   | 0.1565 | 0.0846 |
| 0.0016        | 188.99 | 8233 | 1.0391          | 0.8333   | 0.3082     | 1.3564 | 0.8333   | 0.8183   | 0.1564 | 0.0848 |
| 0.0016        | 189.98 | 8276 | 1.0393          | 0.8333   | 0.3081     | 1.3561 | 0.8333   | 0.8183   | 0.1562 | 0.0847 |
| 0.0016        | 190.99 | 8320 | 1.0398          | 0.8333   | 0.3084     | 1.3582 | 0.8333   | 0.8183   | 0.1562 | 0.0846 |
| 0.0016        | 192.0  | 8364 | 1.0405          | 0.8333   | 0.3083     | 1.3558 | 0.8333   | 0.8183   | 0.1564 | 0.0847 |
| 0.0016        | 192.99 | 8407 | 1.0401          | 0.8333   | 0.3082     | 1.3558 | 0.8333   | 0.8183   | 0.1564 | 0.0847 |
| 0.0016        | 194.0  | 8451 | 1.0407          | 0.8333   | 0.3083     | 1.3564 | 0.8333   | 0.8183   | 0.1564 | 0.0847 |
| 0.0016        | 194.98 | 8494 | 1.0414          | 0.8333   | 0.3086     | 1.3573 | 0.8333   | 0.8183   | 0.1564 | 0.0847 |
| 0.0015        | 195.99 | 8538 | 1.0410          | 0.8333   | 0.3084     | 1.3567 | 0.8333   | 0.8183   | 0.1564 | 0.0848 |
| 0.0015        | 196.98 | 8581 | 1.0411          | 0.8333   | 0.3084     | 1.3568 | 0.8333   | 0.8183   | 0.1563 | 0.0846 |
| 0.0015        | 197.42 | 8600 | 1.0411          | 0.8333   | 0.3084     | 1.3568 | 0.8333   | 0.8183   | 0.1563 | 0.0847 |


### Framework versions

- Transformers 4.30.2
- Pytorch 1.13.1
- Datasets 2.13.1
- Tokenizers 0.13.3

adve email form letter memo news note report resume scientific