Update GGUF to latest and also 8bit / 4bit
#1
by
ssmits
- opened
Hi, thank you for creating this amazing model.
Would you mind updating the GGUF models to the latest version? This way I can compare the 8-bit and 4-bit performance to the original fp16. Thanks again!