
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# 300-tiny_tobacco3482_og_simkd

This model is a fine-tuned version of [WinKawaks/vit-tiny-patch16-224](https://huggingface.co/WinKawaks/vit-tiny-patch16-224) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1030.4594
- Accuracy: 0.845
- Brier Loss: 0.2507
- Nll: 1.6602
- F1 Micro: 0.845
- F1 Macro: 0.8273
- Ece: 0.1440
- Aurc: 0.0504

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 100

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy | Brier Loss | Nll    | F1 Micro | F1 Macro | Ece    | Aurc   |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:----------:|:------:|:--------:|:--------:|:------:|:------:|
| No log        | 1.0   | 50   | 1063.5994       | 0.215    | 0.8548     | 4.5394 | 0.2150   | 0.0866   | 0.2467 | 0.5619 |
| No log        | 2.0   | 100  | 1058.8120       | 0.53     | 0.6920     | 2.3234 | 0.53     | 0.4420   | 0.3178 | 0.2841 |
| No log        | 3.0   | 150  | 1054.1038       | 0.63     | 0.5596     | 2.2480 | 0.63     | 0.5709   | 0.3050 | 0.1733 |
| No log        | 4.0   | 200  | 1049.1915       | 0.67     | 0.4903     | 2.6916 | 0.67     | 0.5866   | 0.2481 | 0.1460 |
| No log        | 5.0   | 250  | 1049.7939       | 0.71     | 0.4663     | 1.9364 | 0.7100   | 0.6359   | 0.2438 | 0.1365 |
| No log        | 6.0   | 300  | 1048.1417       | 0.69     | 0.4830     | 2.1830 | 0.69     | 0.6309   | 0.2518 | 0.1379 |
| No log        | 7.0   | 350  | 1048.1290       | 0.725    | 0.4265     | 2.1076 | 0.7250   | 0.6383   | 0.2114 | 0.1172 |
| No log        | 8.0   | 400  | 1044.3457       | 0.775    | 0.3807     | 1.9343 | 0.775    | 0.7467   | 0.2407 | 0.0982 |
| No log        | 9.0   | 450  | 1046.8309       | 0.67     | 0.4528     | 2.7967 | 0.67     | 0.6493   | 0.2279 | 0.1225 |
| 1185.4053     | 10.0  | 500  | 1044.5997       | 0.76     | 0.3748     | 2.0448 | 0.76     | 0.7066   | 0.1889 | 0.0965 |
| 1185.4053     | 11.0  | 550  | 1046.6857       | 0.745    | 0.3799     | 2.1911 | 0.745    | 0.7195   | 0.2129 | 0.0936 |
| 1185.4053     | 12.0  | 600  | 1036.3792       | 0.69     | 0.4258     | 2.9605 | 0.69     | 0.6744   | 0.1946 | 0.1255 |
| 1185.4053     | 13.0  | 650  | 1042.4764       | 0.715    | 0.4055     | 2.8193 | 0.715    | 0.7326   | 0.1879 | 0.0969 |
| 1185.4053     | 14.0  | 700  | 1040.1765       | 0.765    | 0.3811     | 2.5360 | 0.765    | 0.7497   | 0.2079 | 0.0957 |
| 1185.4053     | 15.0  | 750  | 1045.1747       | 0.655    | 0.4732     | 3.4740 | 0.655    | 0.6577   | 0.2284 | 0.1180 |
| 1185.4053     | 16.0  | 800  | 1035.7695       | 0.785    | 0.3445     | 2.7152 | 0.785    | 0.7564   | 0.1876 | 0.1176 |
| 1185.4053     | 17.0  | 850  | 1037.5389       | 0.755    | 0.3937     | 2.8771 | 0.755    | 0.7418   | 0.2153 | 0.1097 |
| 1185.4053     | 18.0  | 900  | 1045.9521       | 0.775    | 0.3902     | 2.4149 | 0.775    | 0.7261   | 0.2202 | 0.1157 |
| 1185.4053     | 19.0  | 950  | 1039.2958       | 0.81     | 0.3229     | 1.8751 | 0.81     | 0.8025   | 0.1808 | 0.0855 |
| 1173.9102     | 20.0  | 1000 | 1037.2432       | 0.765    | 0.3557     | 2.4940 | 0.765    | 0.7378   | 0.1849 | 0.0929 |
| 1173.9102     | 21.0  | 1050 | 1042.5205       | 0.785    | 0.3416     | 2.1312 | 0.785    | 0.7641   | 0.2139 | 0.0791 |
| 1173.9102     | 22.0  | 1100 | 1031.1548       | 0.785    | 0.3667     | 2.6195 | 0.785    | 0.7555   | 0.1945 | 0.1464 |
| 1173.9102     | 23.0  | 1150 | 1038.0391       | 0.815    | 0.3085     | 2.4661 | 0.815    | 0.7769   | 0.1814 | 0.0923 |
| 1173.9102     | 24.0  | 1200 | 1033.7769       | 0.75     | 0.3758     | 2.5229 | 0.75     | 0.7341   | 0.1910 | 0.1272 |
| 1173.9102     | 25.0  | 1250 | 1040.0878       | 0.82     | 0.2923     | 2.2061 | 0.82     | 0.7882   | 0.1810 | 0.0600 |
| 1173.9102     | 26.0  | 1300 | 1041.4139       | 0.84     | 0.2750     | 2.0378 | 0.8400   | 0.8224   | 0.1849 | 0.0645 |
| 1173.9102     | 27.0  | 1350 | 1033.1660       | 0.835    | 0.2818     | 1.9645 | 0.835    | 0.8018   | 0.1471 | 0.0771 |
| 1173.9102     | 28.0  | 1400 | 1036.1976       | 0.82     | 0.2973     | 2.2955 | 0.82     | 0.7993   | 0.1691 | 0.0755 |
| 1173.9102     | 29.0  | 1450 | 1035.8601       | 0.845    | 0.2740     | 2.1097 | 0.845    | 0.8171   | 0.1696 | 0.0637 |
| 1169.7248     | 30.0  | 1500 | 1033.2889       | 0.82     | 0.3046     | 2.2615 | 0.82     | 0.7985   | 0.1820 | 0.0910 |
| 1169.7248     | 31.0  | 1550 | 1030.7528       | 0.85     | 0.2549     | 1.8264 | 0.85     | 0.8265   | 0.1459 | 0.0798 |
| 1169.7248     | 32.0  | 1600 | 1030.7676       | 0.835    | 0.2708     | 1.9641 | 0.835    | 0.8127   | 0.1646 | 0.0648 |
| 1169.7248     | 33.0  | 1650 | 1033.2319       | 0.84     | 0.2689     | 1.9015 | 0.8400   | 0.8091   | 0.1652 | 0.0741 |
| 1169.7248     | 34.0  | 1700 | 1039.8257       | 0.82     | 0.2974     | 2.2209 | 0.82     | 0.7998   | 0.1767 | 0.0687 |
| 1169.7248     | 35.0  | 1750 | 1035.8896       | 0.865    | 0.2331     | 1.8113 | 0.865    | 0.8458   | 0.1535 | 0.0674 |
| 1169.7248     | 36.0  | 1800 | 1038.4092       | 0.82     | 0.3014     | 2.1408 | 0.82     | 0.8013   | 0.1708 | 0.0844 |
| 1169.7248     | 37.0  | 1850 | 1034.9086       | 0.84     | 0.2722     | 1.8873 | 0.8400   | 0.8233   | 0.1509 | 0.0689 |
| 1169.7248     | 38.0  | 1900 | 1034.8866       | 0.84     | 0.2751     | 2.1269 | 0.8400   | 0.8196   | 0.1647 | 0.0781 |
| 1169.7248     | 39.0  | 1950 | 1031.3431       | 0.815    | 0.2934     | 2.0669 | 0.815    | 0.7844   | 0.1669 | 0.0839 |
| 1167.1226     | 40.0  | 2000 | 1031.2334       | 0.84     | 0.2766     | 2.1016 | 0.8400   | 0.8322   | 0.1580 | 0.0847 |
| 1167.1226     | 41.0  | 2050 | 1033.4176       | 0.84     | 0.2725     | 1.7005 | 0.8400   | 0.8114   | 0.1473 | 0.0731 |
| 1167.1226     | 42.0  | 2100 | 1032.7366       | 0.83     | 0.2871     | 2.1337 | 0.83     | 0.8037   | 0.1592 | 0.0852 |
| 1167.1226     | 43.0  | 2150 | 1032.4486       | 0.845    | 0.2683     | 2.0076 | 0.845    | 0.8218   | 0.1645 | 0.0852 |
| 1167.1226     | 44.0  | 2200 | 1035.2195       | 0.84     | 0.2660     | 1.8355 | 0.8400   | 0.8147   | 0.1670 | 0.0643 |
| 1167.1226     | 45.0  | 2250 | 1034.2225       | 0.84     | 0.2556     | 1.8249 | 0.8400   | 0.8022   | 0.1622 | 0.0598 |
| 1167.1226     | 46.0  | 2300 | 1032.7642       | 0.845    | 0.2534     | 1.6936 | 0.845    | 0.8166   | 0.1438 | 0.0639 |
| 1167.1226     | 47.0  | 2350 | 1036.8080       | 0.83     | 0.2765     | 1.7153 | 0.83     | 0.8076   | 0.1638 | 0.0600 |
| 1167.1226     | 48.0  | 2400 | 1033.1261       | 0.865    | 0.2290     | 1.7616 | 0.865    | 0.8577   | 0.1402 | 0.0536 |
| 1167.1226     | 49.0  | 2450 | 1036.7234       | 0.84     | 0.2656     | 1.7275 | 0.8400   | 0.8093   | 0.1459 | 0.0597 |
| 1165.4459     | 50.0  | 2500 | 1026.7501       | 0.85     | 0.2643     | 2.0250 | 0.85     | 0.8276   | 0.1577 | 0.0791 |
| 1165.4459     | 51.0  | 2550 | 1033.3628       | 0.825    | 0.2804     | 1.7547 | 0.825    | 0.7943   | 0.1592 | 0.0589 |
| 1165.4459     | 52.0  | 2600 | 1033.1439       | 0.845    | 0.2433     | 1.8201 | 0.845    | 0.8156   | 0.1370 | 0.0559 |
| 1165.4459     | 53.0  | 2650 | 1031.2720       | 0.85     | 0.2602     | 1.8013 | 0.85     | 0.8276   | 0.1550 | 0.0637 |
| 1165.4459     | 54.0  | 2700 | 1031.4177       | 0.845    | 0.2625     | 1.7994 | 0.845    | 0.8295   | 0.1514 | 0.0590 |
| 1165.4459     | 55.0  | 2750 | 1029.6421       | 0.84     | 0.2534     | 1.5053 | 0.8400   | 0.8163   | 0.1512 | 0.0541 |
| 1165.4459     | 56.0  | 2800 | 1032.8274       | 0.85     | 0.2475     | 1.7805 | 0.85     | 0.8405   | 0.1384 | 0.0554 |
| 1165.4459     | 57.0  | 2850 | 1030.2781       | 0.835    | 0.2608     | 1.6087 | 0.835    | 0.8059   | 0.1570 | 0.0585 |
| 1165.4459     | 58.0  | 2900 | 1032.2584       | 0.85     | 0.2434     | 1.6753 | 0.85     | 0.8311   | 0.1389 | 0.0606 |
| 1165.4459     | 59.0  | 2950 | 1031.4507       | 0.845    | 0.2590     | 1.7351 | 0.845    | 0.8291   | 0.1464 | 0.0556 |
| 1163.88       | 60.0  | 3000 | 1031.8136       | 0.85     | 0.2461     | 1.8215 | 0.85     | 0.8329   | 0.1438 | 0.0578 |
| 1163.88       | 61.0  | 3050 | 1032.6718       | 0.86     | 0.2410     | 1.6261 | 0.8600   | 0.8465   | 0.1483 | 0.0566 |
| 1163.88       | 62.0  | 3100 | 1028.8600       | 0.855    | 0.2488     | 1.6111 | 0.855    | 0.8358   | 0.1421 | 0.0578 |
| 1163.88       | 63.0  | 3150 | 1029.1522       | 0.845    | 0.2787     | 1.8558 | 0.845    | 0.8135   | 0.1539 | 0.0591 |
| 1163.88       | 64.0  | 3200 | 1026.7474       | 0.85     | 0.2457     | 1.9070 | 0.85     | 0.8280   | 0.1411 | 0.0570 |
| 1163.88       | 65.0  | 3250 | 1032.3363       | 0.845    | 0.2595     | 1.7872 | 0.845    | 0.8169   | 0.1435 | 0.0616 |
| 1163.88       | 66.0  | 3300 | 1031.6006       | 0.855    | 0.2474     | 1.7063 | 0.855    | 0.8357   | 0.1357 | 0.0521 |
| 1163.88       | 67.0  | 3350 | 1031.1060       | 0.855    | 0.2420     | 1.5538 | 0.855    | 0.8401   | 0.1357 | 0.0562 |
| 1163.88       | 68.0  | 3400 | 1032.2750       | 0.855    | 0.2443     | 1.7408 | 0.855    | 0.8455   | 0.1348 | 0.0520 |
| 1163.88       | 69.0  | 3450 | 1031.3723       | 0.84     | 0.2523     | 1.6058 | 0.8400   | 0.8211   | 0.1356 | 0.0550 |
| 1162.7836     | 70.0  | 3500 | 1032.2831       | 0.855    | 0.2539     | 1.6918 | 0.855    | 0.8386   | 0.1406 | 0.0605 |
| 1162.7836     | 71.0  | 3550 | 1028.9554       | 0.85     | 0.2479     | 1.6822 | 0.85     | 0.8290   | 0.1395 | 0.0567 |
| 1162.7836     | 72.0  | 3600 | 1031.4127       | 0.855    | 0.2495     | 1.7386 | 0.855    | 0.8386   | 0.1365 | 0.0564 |
| 1162.7836     | 73.0  | 3650 | 1031.2170       | 0.86     | 0.2450     | 1.7208 | 0.8600   | 0.8454   | 0.1337 | 0.0551 |
| 1162.7836     | 74.0  | 3700 | 1030.2428       | 0.86     | 0.2458     | 1.7499 | 0.8600   | 0.8454   | 0.1490 | 0.0525 |
| 1162.7836     | 75.0  | 3750 | 1031.7998       | 0.86     | 0.2442     | 1.6081 | 0.8600   | 0.8384   | 0.1373 | 0.0569 |
| 1162.7836     | 76.0  | 3800 | 1030.5450       | 0.85     | 0.2469     | 1.5548 | 0.85     | 0.8354   | 0.1380 | 0.0563 |
| 1162.7836     | 77.0  | 3850 | 1031.4061       | 0.855    | 0.2383     | 1.6571 | 0.855    | 0.8376   | 0.1313 | 0.0549 |
| 1162.7836     | 78.0  | 3900 | 1033.5166       | 0.85     | 0.2554     | 1.5379 | 0.85     | 0.8279   | 0.1400 | 0.0572 |
| 1162.7836     | 79.0  | 3950 | 1033.4709       | 0.855    | 0.2496     | 1.5471 | 0.855    | 0.8437   | 0.1287 | 0.0524 |
| 1162.105      | 80.0  | 4000 | 1031.8766       | 0.85     | 0.2453     | 1.6612 | 0.85     | 0.8325   | 0.1388 | 0.0556 |
| 1162.105      | 81.0  | 4050 | 1030.5789       | 0.855    | 0.2441     | 1.7341 | 0.855    | 0.8356   | 0.1259 | 0.0535 |
| 1162.105      | 82.0  | 4100 | 1033.6682       | 0.85     | 0.2517     | 1.6263 | 0.85     | 0.8340   | 0.1443 | 0.0513 |
| 1162.105      | 83.0  | 4150 | 1031.2977       | 0.855    | 0.2425     | 1.6676 | 0.855    | 0.8427   | 0.1334 | 0.0537 |
| 1162.105      | 84.0  | 4200 | 1027.3252       | 0.86     | 0.2456     | 1.7430 | 0.8600   | 0.8515   | 0.1326 | 0.0542 |
| 1162.105      | 85.0  | 4250 | 1030.4331       | 0.855    | 0.2454     | 1.7415 | 0.855    | 0.8439   | 0.1507 | 0.0501 |
| 1162.105      | 86.0  | 4300 | 1031.9957       | 0.845    | 0.2553     | 1.6819 | 0.845    | 0.8322   | 0.1463 | 0.0497 |
| 1162.105      | 87.0  | 4350 | 1031.3456       | 0.845    | 0.2543     | 1.7632 | 0.845    | 0.8240   | 0.1503 | 0.0556 |
| 1162.105      | 88.0  | 4400 | 1030.5261       | 0.845    | 0.2522     | 1.7459 | 0.845    | 0.8243   | 0.1450 | 0.0482 |
| 1162.105      | 89.0  | 4450 | 1028.4374       | 0.845    | 0.2507     | 1.6968 | 0.845    | 0.8243   | 0.1356 | 0.0538 |
| 1161.3639     | 90.0  | 4500 | 1030.4808       | 0.845    | 0.2501     | 1.6386 | 0.845    | 0.8240   | 0.1442 | 0.0531 |
| 1161.3639     | 91.0  | 4550 | 1032.4968       | 0.845    | 0.2583     | 1.7297 | 0.845    | 0.8235   | 0.1329 | 0.0519 |
| 1161.3639     | 92.0  | 4600 | 1031.8092       | 0.85     | 0.2523     | 1.6594 | 0.85     | 0.8340   | 0.1411 | 0.0519 |
| 1161.3639     | 93.0  | 4650 | 1031.8936       | 0.85     | 0.2539     | 1.7723 | 0.85     | 0.8366   | 0.1392 | 0.0475 |
| 1161.3639     | 94.0  | 4700 | 1031.4855       | 0.855    | 0.2525     | 1.6232 | 0.855    | 0.8448   | 0.1477 | 0.0508 |
| 1161.3639     | 95.0  | 4750 | 1027.4985       | 0.855    | 0.2502     | 1.8411 | 0.855    | 0.8448   | 0.1442 | 0.0510 |
| 1161.3639     | 96.0  | 4800 | 1031.0199       | 0.85     | 0.2500     | 1.7087 | 0.85     | 0.8353   | 0.1342 | 0.0488 |
| 1161.3639     | 97.0  | 4850 | 1031.1750       | 0.84     | 0.2592     | 1.7172 | 0.8400   | 0.8152   | 0.1407 | 0.0530 |
| 1161.3639     | 98.0  | 4900 | 1032.8660       | 0.845    | 0.2541     | 1.6367 | 0.845    | 0.8273   | 0.1352 | 0.0488 |
| 1161.3639     | 99.0  | 4950 | 1029.1611       | 0.855    | 0.2509     | 1.6982 | 0.855    | 0.8448   | 0.1485 | 0.0525 |
| 1161.2033     | 100.0 | 5000 | 1030.4594       | 0.845    | 0.2507     | 1.6602 | 0.845    | 0.8273   | 0.1440 | 0.0504 |


### Framework versions

- Transformers 4.26.1
- Pytorch 1.13.1.post200
- Datasets 2.9.0
- Tokenizers 0.13.2

adve email form letter memo news note report resume scientific