Update GGUF to latest and also 8bit / 4bit

#1
by ssmits - opened

Hi, thank you for creating this amazing model.
Would you mind updating the GGUF models to the latest version? This way I can compare the 8-bit and 4-bit performance to the original fp16. Thanks again!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment