reduce the size of finetuned model

by zubator - opened Jun 9, 2023

Jun 9, 2023

Hi
I tried to play with fine tuning and I got a standard size 24Gb. I was able only to convert it to f16. But the size is still bit - 12Gb. How can I reduce even more? Like you have now for 1.3 revision.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment