quantizations
#1
by
Aryanne
- opened
can you quantize? https://huggingface.co/xiaol/RWKV-claude-for-mobile-v4-world-1.5B-16k
Sure, in progress. Will probably be up on my repo in an hour or so.
Oh, but bear in mind - this will still be ggml, not gguf - at least at this moment, quantized with the freshly pulled rwkvcpp update.
latestissue
changed discussion status to
closed
This comment has been hidden
latestissue
changed discussion status to
open