How did you manage to quantize this model?

by SaffalPoosh - opened Jul 4, 2023

Jul 4, 2023

the method in readme is loading all the checkpoints, can you please suggest how did you manage to quantize it and on what GPU?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment