
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# swin-tiny-patch4-window7-224-finetuned-birds

This model is a fine-tuned version of [microsoft/swin-tiny-patch4-window7-224](https://huggingface.co/microsoft/swin-tiny-patch4-window7-224) on the bird-data dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6642
- Accuracy: 0.8215

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 72
- eval_batch_size: 72
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 288
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 10

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
| 3.8854        | 0.99  | 74   | 3.0164          | 0.3039   |
| 2.066         | 1.99  | 148  | 1.4849          | 0.6095   |
| 1.5066        | 2.99  | 222  | 1.0624          | 0.7145   |
| 1.1904        | 3.99  | 296  | 0.9347          | 0.7450   |
| 0.9986        | 4.99  | 370  | 0.8415          | 0.7709   |
| 0.9437        | 5.99  | 444  | 0.7713          | 0.7901   |
| 0.8297        | 6.99  | 518  | 0.7216          | 0.8081   |
| 0.7805        | 7.99  | 592  | 0.6856          | 0.8152   |
| 0.6978        | 8.99  | 666  | 0.6642          | 0.8215   |
| 0.6147        | 9.99  | 740  | 0.6525          | 0.8207   |


### Framework versions

- Transformers 4.26.1
- Pytorch 1.13.1+cu116
- Datasets 2.10.1
- Tokenizers 0.13.2

abert's towhee acorn woodpecker allen's hummingbird american avocet american black duck american coot american crow american dipper american goldfinch american kestrel american oystercatcher american pipit american redstart american robin american tree sparrow american white pelican american wigeon american woodcock anhinga anna's hummingbird ash-throated flycatcher bald eagle baltimore oriole band-tailed pigeon bank swallow barn owl barn swallow barred owl barrow's goldeneye bay-breasted warbler bell's vireo belted kingfisher bewick's wren black guillemot black oystercatcher black phoebe black rosy-finch black scoter black skimmer black tern black turnstone black vulture black-and-white warbler black-bellied plover black-bellied whistling-duck black-billed cuckoo black-billed magpie black-capped chickadee black-chinned hummingbird black-crested titmouse black-crowned night-heron black-headed grosbeak black-legged kittiwake black-necked stilt black-tailed gnatcatcher black-throated blue warbler black-throated gray warbler black-throated green warbler blackburnian warbler blackpoll warbler blue grosbeak blue jay blue-gray gnatcatcher blue-headed vireo blue-winged teal blue-winged warbler boat-tailed grackle bobolink bohemian waxwing bonaparte's gull boreal chickadee brandt's cormorant brant brewer's blackbird brewer's sparrow bridled titmouse broad-billed hummingbird broad-tailed hummingbird broad-winged hawk bronzed cowbird brown creeper brown pelican brown thrasher brown-capped rosy-finch brown-headed cowbird brown-headed nuthatch bufflehead bullock's oriole burrowing owl bushtit cackling goose cactus wren california gull california quail california thrasher california towhee calliope hummingbird canada goose canada warbler canvasback canyon towhee canyon wren cape may warbler carolina chickadee carolina wren caspian tern cassin's finch cassin's kingbird cassin's vireo cattle egret cave swallow cedar waxwing chestnut-backed chickadee chestnut-sided warbler chihuahuan raven chimney swift chipping sparrow cinnamon teal clark's grebe clark's nutcracker clay-colored sparrow cliff swallow common eider common gallinule common goldeneye common grackle common ground-dove common loon common merganser common nighthawk common raven common redpoll common tern common yellowthroat cooper's hawk cordilleran flycatcher costa's hummingbird crested caracara curve-billed thrasher dark-eyed junco dickcissel double-crested cormorant downy woodpecker dunlin eared grebe eastern bluebird eastern kingbird eastern meadowlark eastern phoebe eastern screech-owl eastern towhee eastern wood-pewee eurasian collared-dove eurasian eagle-owl european starling evening grosbeak field sparrow fish crow florida scrub-jay forster's tern fox sparrow gadwall gambel's quail gila woodpecker glaucous-winged gull glossy ibis golden eagle golden-crowned kinglet golden-crowned sparrow golden-fronted woodpecker gray catbird gray jay gray-crowned rosy-finch great black-backed gull great blue heron great cormorant great crested flycatcher great egret great horned owl great-tailed grackle greater roadrunner greater scaup greater white-fronted goose greater yellowlegs green heron green-tailed towhee green-winged teal hairy woodpecker harlequin duck harris's hawk harris's sparrow heermann's gull hermit thrush hermit warbler herring gull hoary redpoll hooded merganser hooded oriole hooded warbler horned grebe horned lark house finch house sparrow house wren hutton's vireo inca dove indigo bunting juniper titmouse killdeer ladder-backed woodpecker lark bunting lark sparrow laughing gull lazuli bunting least flycatcher least sandpiper lesser goldfinch lesser scaup lesser yellowlegs lincoln's sparrow little blue heron loggerhead shrike long-billed curlew long-tailed duck louisiana waterthrush macgillivray's warbler magnolia warbler mallard marbled godwit marsh wren merlin mew gull mexican jay mississippi kite monk parakeet mottled duck mountain bluebird mountain chickadee mourning dove mourning warbler mute swan nashville warbler neotropic cormorant northern bobwhite northern cardinal northern flicker northern gannet northern harrier northern mockingbird northern parula northern pintail northern pygmy-owl northern rough-winged swallow northern saw-whet owl northern shoveler northern shrike northern waterthrush northwestern crow nuttall's woodpecker oak titmouse orange-crowned warbler orchard oriole osprey ovenbird pacific loon pacific wren pacific-slope flycatcher painted bunting palm warbler pelagic cormorant peregrine falcon phainopepla pied-billed grebe pigeon guillemot pileated woodpecker pine grosbeak pine siskin pine warbler plumbeous vireo prairie falcon prairie warbler prothonotary warbler purple finch purple gallinule purple martin pygmy nuthatch pyrrhuloxia red crossbill red-bellied woodpecker red-breasted merganser red-breasted nuthatch red-breasted sapsucker red-eyed vireo red-headed woodpecker red-naped sapsucker red-necked grebe red-shouldered hawk red-tailed hawk red-throated loon red-winged blackbird reddish egret redhead ring-billed gull ring-necked duck ring-necked pheasant rock pigeon rose-breasted grosbeak roseate spoonbill ross's goose rough-legged hawk royal tern ruby-crowned kinglet ruby-throated hummingbird ruddy duck ruddy turnstone ruffed grouse rufous hummingbird rufous-crowned sparrow rusty blackbird sanderling sandhill crane savannah sparrow say's phoebe scaled quail scarlet tanager scissor-tailed flycatcher semipalmated plover semipalmated sandpiper sharp-shinned hawk short-billed dowitcher snow bunting snow goose snowy egret snowy owl solitary sandpiper song sparrow spotted sandpiper spotted towhee steller's jay summer tanager surf scoter surfbird swainson's hawk swainson's thrush swallow-tailed kite swamp sparrow tennessee warbler townsend's solitaire townsend's warbler tree swallow tricolored heron trumpeter swan tufted titmouse tundra swan turkey vulture varied thrush vaux's swift veery verdin vermilion flycatcher vesper sparrow violet-green swallow warbling vireo western bluebird western grebe western gull western kingbird western meadowlark western sandpiper western screech-owl western scrub-jay western tanager western wood-pewee whimbrel white ibis white-breasted nuthatch white-crowned sparrow white-eyed vireo white-faced ibis white-tailed kite white-throated sparrow white-throated swift white-winged crossbill white-winged dove white-winged scoter wild turkey willet wilson's phalarope wilson's snipe wilson's warbler winter wren wood duck wood stork wood thrush wrentit yellow warbler yellow-bellied sapsucker yellow-billed cuckoo yellow-billed magpie yellow-breasted chat yellow-crowned night-heron yellow-headed blackbird yellow-rumped warbler yellow-throated vireo yellow-throated warbler