
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# birds_transform_full

This model is a fine-tuned version of [google/vit-base-patch16-224-in21k](https://huggingface.co/google/vit-base-patch16-224-in21k) on the imagefolder dataset.
It achieves the following results on the evaluation set:
- Accuracy: 0.7303
- Loss: 1.4588

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch | Step   | Accuracy | Validation Loss |
|:-------------:|:-----:|:------:|:--------:|:---------------:|
| 5.6427        | 1.0   | 1984   | 0.4519   | 5.2504          |
| 4.6563        | 2.0   | 3968   | 0.5068   | 4.2749          |
| 3.6656        | 3.0   | 5952   | 0.5454   | 3.3311          |
| 2.7653        | 4.0   | 7936   | 0.5748   | 2.5181          |
| 2.0465        | 5.0   | 9920   | 0.6300   | 1.9205          |
| 1.5876        | 6.0   | 11904  | 0.6593   | 1.5696          |
| 1.3174        | 7.0   | 13888  | 0.6870   | 1.3831          |
| 1.1279        | 8.0   | 15872  | 0.7064   | 1.2516          |
| 1.0051        | 9.0   | 17856  | 0.7067   | 1.1999          |
| 0.9318        | 10.0  | 19840  | 0.7077   | 1.1631          |
| 0.8294        | 11.0  | 21824  | 0.7089   | 1.1444          |
| 0.7976        | 12.0  | 23808  | 0.7175   | 1.1156          |
| 0.7084        | 13.0  | 25792  | 0.7218   | 1.1209          |
| 0.6752        | 14.0  | 27776  | 0.7198   | 1.1032          |
| 0.6641        | 15.0  | 29760  | 0.7198   | 1.1192          |
| 0.6083        | 16.0  | 31744  | 0.7268   | 1.1044          |
| 0.5703        | 17.0  | 33728  | 0.7248   | 1.1287          |
| 0.5376        | 18.0  | 35712  | 0.7286   | 1.1115          |
| 0.5073        | 19.0  | 37696  | 0.7218   | 1.1429          |
| 0.5072        | 20.0  | 39680  | 0.7208   | 1.1519          |
| 0.4945        | 21.0  | 41664  | 0.7228   | 1.1636          |
| 0.4651        | 22.0  | 43648  | 0.7213   | 1.1771          |
| 0.4408        | 23.0  | 45632  | 0.7233   | 1.1650          |
| 0.4222        | 24.0  | 47616  | 0.7157   | 1.1841          |
| 0.409         | 25.0  | 49600  | 0.7145   | 1.2150          |
| 0.403         | 26.0  | 51584  | 0.7152   | 1.2203          |
| 0.3813        | 27.0  | 53568  | 0.7238   | 1.2064          |
| 0.3756        | 28.0  | 55552  | 0.7177   | 1.2526          |
| 0.365         | 29.0  | 57536  | 0.7208   | 1.2670          |
| 0.3729        | 30.0  | 59520  | 0.7180   | 1.2659          |
| 0.36          | 31.0  | 61504  | 0.7127   | 1.2545          |
| 0.3596        | 32.0  | 63488  | 0.7182   | 1.2728          |
| 0.3606        | 33.0  | 65472  | 0.7180   | 1.2886          |
| 0.325         | 34.0  | 67456  | 0.7157   | 1.2929          |
| 0.329         | 35.0  | 69440  | 0.7205   | 1.3074          |
| 0.3431        | 36.0  | 71424  | 0.7185   | 1.3122          |
| 0.3206        | 37.0  | 73408  | 0.7233   | 1.2993          |
| 0.3137        | 38.0  | 75392  | 0.7220   | 1.3206          |
| 0.3265        | 39.0  | 77376  | 0.7180   | 1.3246          |
| 0.3332        | 40.0  | 79360  | 0.7240   | 1.3163          |
| 0.3193        | 41.0  | 81344  | 0.7288   | 1.3259          |
| 0.3242        | 42.0  | 83328  | 0.7215   | 1.3320          |
| 0.2976        | 43.0  | 85312  | 0.7213   | 1.3283          |
| 0.3191        | 44.0  | 87296  | 0.7195   | 1.3453          |
| 0.3067        | 45.0  | 89280  | 0.7243   | 1.3550          |
| 0.2994        | 46.0  | 91264  | 0.7240   | 1.3324          |
| 0.3072        | 47.0  | 93248  | 0.7263   | 1.3412          |
| 0.2932        | 48.0  | 95232  | 0.7245   | 1.3345          |
| 0.2919        | 49.0  | 97216  | 0.7266   | 1.3759          |
| 0.2922        | 50.0  | 99200  | 0.7225   | 1.3873          |
| 0.304         | 51.0  | 101184 | 0.7235   | 1.3631          |
| 0.2898        | 52.0  | 103168 | 0.7205   | 1.3819          |
| 0.2773        | 53.0  | 105152 | 0.7251   | 1.3827          |
| 0.2756        | 54.0  | 107136 | 0.7228   | 1.3770          |
| 0.2789        | 55.0  | 109120 | 0.7248   | 1.3822          |
| 0.261         | 56.0  | 111104 | 0.7263   | 1.3878          |
| 0.2593        | 57.0  | 113088 | 0.7240   | 1.3955          |
| 0.2801        | 58.0  | 115072 | 0.7256   | 1.3659          |
| 0.2632        | 59.0  | 117056 | 0.7301   | 1.3719          |
| 0.2811        | 60.0  | 119040 | 0.7321   | 1.3775          |
| 0.2267        | 61.0  | 121024 | 0.7256   | 1.3689          |
| 0.2676        | 62.0  | 123008 | 0.7245   | 1.4069          |
| 0.2523        | 63.0  | 124992 | 0.7230   | 1.4166          |
| 0.2622        | 64.0  | 126976 | 0.7296   | 1.4018          |
| 0.2467        | 65.0  | 128960 | 0.7256   | 1.4287          |
| 0.2504        | 66.0  | 130944 | 0.7314   | 1.4019          |
| 0.2468        | 67.0  | 132928 | 0.7303   | 1.4058          |
| 0.2098        | 68.0  | 134912 | 0.7308   | 1.4093          |
| 0.2382        | 69.0  | 136896 | 0.7293   | 1.4206          |
| 0.2304        | 70.0  | 138880 | 0.7301   | 1.4078          |
| 0.251         | 71.0  | 140864 | 0.7251   | 1.4275          |
| 0.237         | 72.0  | 142848 | 0.7288   | 1.4283          |
| 0.2485        | 73.0  | 144832 | 0.7281   | 1.4338          |
| 0.2229        | 74.0  | 146816 | 0.7253   | 1.4386          |
| 0.2472        | 75.0  | 148800 | 0.7210   | 1.4440          |
| 0.2149        | 76.0  | 150784 | 0.7230   | 1.4319          |
| 0.2337        | 77.0  | 152768 | 0.7261   | 1.4422          |
| 0.2063        | 78.0  | 154752 | 0.7268   | 1.4456          |
| 0.216         | 79.0  | 156736 | 0.7218   | 1.4426          |
| 0.2249        | 80.0  | 158720 | 0.7198   | 1.4533          |
| 0.2148        | 81.0  | 160704 | 0.7230   | 1.4480          |
| 0.2321        | 82.0  | 162688 | 0.7273   | 1.4416          |
| 0.2306        | 83.0  | 164672 | 0.7286   | 1.4392          |
| 0.213         | 84.0  | 166656 | 0.7263   | 1.4609          |
| 0.2202        | 85.0  | 168640 | 0.7266   | 1.4590          |
| 0.206         | 86.0  | 170624 | 0.7245   | 1.4638          |
| 0.1987        | 87.0  | 172608 | 0.7251   | 1.4626          |
| 0.2181        | 88.0  | 174592 | 0.7261   | 1.4615          |
| 0.2076        | 89.0  | 176576 | 0.7253   | 1.4665          |
| 0.1999        | 90.0  | 178560 | 0.7251   | 1.4569          |
| 0.2287        | 91.0  | 180544 | 0.7266   | 1.4591          |
| 0.1985        | 92.0  | 182528 | 0.7263   | 1.4508          |
| 0.2166        | 93.0  | 184512 | 0.7266   | 1.4621          |
| 0.1943        | 94.0  | 186496 | 0.7276   | 1.4649          |
| 0.2189        | 95.0  | 188480 | 0.7293   | 1.4555          |
| 0.1911        | 96.0  | 190464 | 0.7306   | 1.4565          |
| 0.1954        | 97.0  | 192448 | 0.7271   | 1.4624          |
| 0.2053        | 98.0  | 194432 | 0.7286   | 1.4603          |
| 0.2067        | 99.0  | 196416 | 0.7306   | 1.4589          |
| 0.1917        | 100.0 | 198400 | 0.7303   | 1.4588          |


### Framework versions

- Transformers 4.34.0
- Pytorch 2.1.0+cu121
- Datasets 2.14.5
- Tokenizers 0.14.1

acadian_flycatcher acorn_woodpecker alder_flycatcher allens_hummingbird altamira_oriole american_avocet american_bittern american_black_duck american_coot american_crow american_dipper american_golden_plover american_goldfinch american_kestrel american_oystercatcher american_pipit american_redstart american_robin american_three_toed_woodpecker american_tree_sparrow american_white_pelican american_wigeon american_woodcock anhinga annas_hummingbird arctic_tern ash_throated_flycatcher audubons_oriole bairds_sandpiper bald_eagle baltimore_oriole band_tailed_pigeon barn_swallow barred_owl barrows_goldeneye bay_breasted_warbler bells_vireo belted_kingfisher bewicks_wren black_guillemot black_oystercatcher black_phoebe black_rosy_finch black_scoter black_skimmer black_tern black_turnstone black_vulture black_and_white_warbler black_backed_woodpecker black_bellied_plover black_billed_cuckoo black_billed_magpie black_capped_chickadee black_chinned_hummingbird black_chinned_sparrow black_crested_titmouse black_crowned_night_heron black_headed_grosbeak black_legged_kittiwake black_necked_stilt black_throated_blue_warbler black_throated_gray_warbler black_throated_green_warbler black_throated_sparrow blackburnian_warbler blackpoll_warbler blue_grosbeak blue_jay blue_gray_gnatcatcher blue_headed_vireo blue_winged_teal blue_winged_warbler boat_tailed_grackle bobolink bohemian_waxwing bonapartes_gull boreal_chickadee brandts_cormorant brant brewers_blackbird brewers_sparrow bridled_titmouse broad_billed_hummingbird broad_tailed_hummingbird broad_winged_hawk bronzed_cowbird brown_creeper brown_pelican brown_thrasher brown_capped_rosy_finch brown_crested_flycatcher brown_headed_cowbird brown_headed_nuthatch bufflehead bullocks_oriole burrowing_owl bushtit cackling_goose cactus_wren california_gull california_quail california_thrasher california_towhee calliope_hummingbird canada_goose canada_warbler canvasback canyon_towhee canyon_wren cape_may_warbler carolina_chickadee carolina_wren caspian_tern cassins_finch cassins_kingbird cassins_sparrow cassins_vireo cattle_egret cave_swallow cedar_waxwing cerulean_warbler chestnut_backed_chickadee chestnut_collared_longspur chestnut_sided_warbler chihuahuan_raven chimney_swift chipping_sparrow cinnamon_teal clapper_rail clarks_grebe clarks_nutcracker clay_colored_sparrow cliff_swallow common_black_hawk common_eider common_gallinule common_goldeneye common_grackle common_ground_dove common_loon common_merganser common_murre common_nighthawk common_raven common_redpoll common_tern common_yellowthroat connecticut_warbler coopers_hawk cordilleran_flycatcher costas_hummingbird couchs_kingbird crested_caracara curve_billed_thrasher dark_eyed_junco dickcissel double_crested_cormorant downy_woodpecker dunlin dusky_flycatcher dusky_grouse eared_grebe eastern_bluebird eastern_kingbird eastern_meadowlark eastern_phoebe eastern_screech_owl eastern_towhee eastern_wood_pewee elegant_trogon elf_owl eurasian_collared_dove eurasian_wigeon european_starling evening_grosbeak ferruginous_hawk ferruginous_pygmy_owl field_sparrow fish_crow florida_scrub_jay forsters_tern fox_sparrow franklins_gull fulvous_whistling_duck gadwall gambels_quail gila_woodpecker glaucous_gull glaucous_winged_gull glossy_ibis golden_eagle golden_crowned_kinglet golden_crowned_sparrow golden_fronted_woodpecker golden_winged_warbler grasshopper_sparrow gray_catbird gray_flycatcher gray_jay gray_kingbird gray_cheeked_thrush gray_crowned_rosy_finch great_black_backed_gull great_blue_heron great_cormorant great_crested_flycatcher great_egret great_gray_owl great_horned_owl great_kiskadee great_tailed_grackle greater_prairie_chicken greater_roadrunner greater_sage_grouse greater_scaup greater_white_fronted_goose greater_yellowlegs green_jay green_tailed_towhee green_winged_teal groove_billed_ani gull_billed_tern hairy_woodpecker hammonds_flycatcher harlequin_duck harriss_hawk harriss_sparrow heermanns_gull henslows_sparrow hepatic_tanager hermit_thrush herring_gull hoary_redpoll hooded_merganser hooded_oriole hooded_warbler horned_grebe horned_lark house_finch house_sparrow house_wren huttons_vireo iceland_gull inca_dove indigo_bunting killdeer king_rail ladder_backed_woodpecker lapland_longspur lark_bunting lark_sparrow laughing_gull lazuli_bunting le_contes_sparrow least_bittern least_flycatcher least_grebe least_sandpiper least_tern lesser_goldfinch lesser_nighthawk lesser_scaup lesser_yellowlegs lewiss_woodpecker limpkin lincolns_sparrow little_blue_heron loggerhead_shrike long_billed_curlew long_billed_dowitcher long_billed_thrasher long_eared_owl long_tailed_duck louisiana_waterthrush magnificent_frigatebird magnolia_warbler mallard marbled_godwit marsh_wren merlin mew_gull mexican_jay mississippi_kite monk_parakeet mottled_duck mountain_bluebird mountain_chickadee mountain_plover mourning_dove mourning_warbler muscovy_duck mute_swan nashville_warbler nelsons_sparrow neotropic_cormorant northern_bobwhite northern_cardinal northern_flicker northern_gannet northern_goshawk northern_harrier northern_hawk_owl northern_mockingbird northern_parula northern_pintail northern_rough_winged_swallow northern_saw_whet_owl northern_shrike northern_waterthrush nuttalls_woodpecker oak_titmouse olive_sparrow olive_sided_flycatcher orange_crowned_warbler orchard_oriole osprey ovenbird pacific_golden_plover pacific_loon pacific_wren pacific_slope_flycatcher painted_bunting painted_redstart palm_warbler pectoral_sandpiper peregrine_falcon phainopepla philadelphia_vireo pied_billed_grebe pigeon_guillemot pileated_woodpecker pine_grosbeak pine_siskin pine_warbler piping_plover plumbeous_vireo prairie_falcon prairie_warbler prothonotary_warbler purple_finch purple_gallinule purple_martin purple_sandpiper pygmy_nuthatch pyrrhuloxia red_crossbill red_knot red_phalarope red_bellied_woodpecker red_breasted_merganser red_breasted_nuthatch red_breasted_sapsucker red_cockaded_woodpecker red_eyed_vireo red_headed_woodpecker red_naped_sapsucker red_necked_grebe red_necked_phalarope red_shouldered_hawk red_tailed_hawk red_throated_loon red_winged_blackbird reddish_egret redhead ring_billed_gull ring_necked_duck ring_necked_pheasant rock_pigeon rock_ptarmigan rock_sandpiper rock_wren rose_breasted_grosbeak roseate_tern rosss_goose rough_legged_hawk royal_tern ruby_crowned_kinglet ruby_throated_hummingbird ruddy_duck ruddy_turnstone ruffed_grouse rufous_hummingbird rufous_crowned_sparrow rusty_blackbird sage_thrasher saltmarsh_sparrow sanderling sandhill_crane sandwich_tern says_phoebe scaled_quail scarlet_tanager scissor_tailed_flycatcher scotts_oriole seaside_sparrow sedge_wren semipalmated_plover semipalmated_sandpiper sharp_shinned_hawk sharp_tailed_grouse short_billed_dowitcher short_eared_owl snail_kite snow_bunting snow_goose snowy_egret snowy_owl snowy_plover solitary_sandpiper song_sparrow sooty_grouse sora spotted_owl spotted_sandpiper spotted_towhee spruce_grouse stellers_jay stilt_sandpiper summer_tanager surf_scoter surfbird swainsons_hawk swainsons_thrush swallow_tailed_kite swamp_sparrow tennessee_warbler thayers_gull townsends_solitaire townsends_warbler tree_swallow tricolored_heron tropical_kingbird trumpeter_swan tufted_titmouse tundra_swan turkey_vulture upland_sandpiper varied_thrush veery verdin vermilion_flycatcher vesper_sparrow violet_green_swallow virginia_rail wandering_tattler warbling_vireo western_bluebird western_grebe western_gull western_kingbird western_meadowlark western_sandpiper western_screech_owl western_scrub_jay western_tanager western_wood_pewee whimbrel white_ibis white_breasted_nuthatch white_crowned_sparrow white_eyed_vireo white_faced_ibis white_headed_woodpecker white_rumped_sandpiper white_tailed_hawk white_tailed_kite white_tailed_ptarmigan white_throated_sparrow white_throated_swift white_winged_crossbill white_winged_dove white_winged_scoter wild_turkey willet williamsons_sapsucker willow_flycatcher willow_ptarmigan wilsons_phalarope wilsons_plover wilsons_snipe wilsons_warbler winter_wren wood_stork wood_thrush worm_eating_warbler wrentit yellow_warbler yellow_bellied_flycatcher yellow_bellied_sapsucker yellow_billed_cuckoo yellow_billed_magpie yellow_breasted_chat yellow_crowned_night_heron yellow_eyed_junco yellow_headed_blackbird yellow_rumped_warbler yellow_throated_vireo yellow_throated_warbler zone_tailed_hawk