
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# beit-sketch-classifier-pt-metaset-2

This model is a fine-tuned version of [microsoft/beit-base-patch16-224-pt22k-ft22k](https://huggingface.co/microsoft/beit-base-patch16-224-pt22k-ft22k) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6703
- Accuracy: 0.8282

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 32
- eval_batch_size: 32
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 128
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 5

### Training results

| Training Loss | Epoch | Step   | Validation Loss | Accuracy |
|:-------------:|:-----:|:------:|:---------------:|:--------:|
| 0.8028        | 1.0   | 76608  | 0.7586          | 0.8007   |
| 0.7168        | 2.0   | 153216 | 0.6983          | 0.8154   |
| 0.6357        | 3.0   | 229824 | 0.6676          | 0.8240   |
| 0.5707        | 4.0   | 306432 | 0.6606          | 0.8276   |
| 0.4254        | 5.0   | 383040 | 0.6703          | 0.8282   |


### Framework versions

- Transformers 4.25.1
- Pytorch 1.13.1+cu117
- Datasets 2.7.1
- Tokenizers 0.13.2

the eiffel tower the great wall of china the mona lisa aircraft carrier airplane alarm clock alien ambulance angel animal migration ant anvil ape apple arm armchair armor ashtray asparagus axe backpack banana bandage barn baseball baseball bat basket basketball bat bathtub beach bear beard bed bee beer mug beetle bell belt bench bicycle binoculars bird birthday cake blackberry blimp blueberry book bookshelf boomerang bottle opener bottlecap bowl bowtie boy bracelet brain bread bridge broccoli broom bucket bulldozer bus bush butterfly cabin cabinet cactus cake calculator calendar camel camera camouflage campfire candle cannon canoe car carrot castle cat ceiling fan cell phone cello chair chandelier chicken church cigarette circle clarinet clock cloud coffee cup comb compass computer computer monitor computer-mouse cookie cooler couch cow crab crane (machine) crayon crocodile crocodilian crown cruise ship cup deer diamond dishwasher diving board dog dolphin donut door door handle dragon dresser drill drums duck dumbbell ear elbow elephant elf envelope eraser eye eyeglasses face fairy fan feather fence finger fire hydrant fireplace firetruck fish flamingo flashlight flip flops floor lamp flower flower with stem flying bird flying saucer foot fork frog frying pan garden garden hose geyser giraffe girl goatee golf club grapes grass grenade guitar hamburger hammer hand harp hat head headphones hedgehog helicopter helmet hexagon hockey puck hockey stick horse hospital hot air balloon hot dog hot tub hot-air balloon hotdog hourglass house house plant human-skeleton hurricane ice cream ipod jack-o-lantern jacket jail jellyfish kangaroo key keyboard knee knife ladder lantern laptop leaf leg light bulb lighter lighthouse lightning line lion lipstick lizard lobster lollipop loudspeaker mailbox man map marker matches megaphone mermaid microphone microscope microwave monkey moon mosquito motorbike motorcycle mountain mouse moustache mouth mug mushroom nail necklace nose ocean octagon octopus onion oven owl paint can paintbrush palm tree panda pants paper clip parachute parking meter parrot passport peanut pear peas pen pencil penguin person sitting person standing person walking piano pickup truck picture frame pig pigeon pillow pineapple pipe (for smoking) pistol pizza planet pliers police car pond pool popsicle postcard potato potted plant power outlet present pretzel pumpkin purse rabbit raccoon race car racket radio rain rainbow rake ray remote control revolver rhinoceros rifle river robot rocket roller coaster rollerblades rollerskates rooster sailboat sandwich santa claus satellite satellite dish saw saxophone school bus scissors scorpion screwdriver sea turtle seagull seal see saw shark sheep ship shoe shorts shovel sink skateboard skull skyscraper sleeping bag smiley face snail snake snorkel snowboard snowflake snowman soccer ball sock socks songbird space shuttle speedboat spider sponge bob spoon spreadsheet square squiggle squirrel stairs stapler star starfish steak stereo stethoscope stitches stop sign stove strawberry streetlight string bean submarine suitcase sun suv swan sweater swing set sword syringe t-shirt table tablelamp tank teacup teapot teddy-bear telephone television tennis-racket tent tiger tire toaster toe toilet tomato tooth toothbrush toothpaste tornado tractor traffic light train tree triangle trombone trousers truck trumpet turtle tv umbrella underwear van vase violin volcano walkie talkie washing machine watermelon waterslide whale wheel wheelbarrow wheelchair windmill window wine bottle wine glass wineglass wizard woman wristwatch yoga zebra zigzag