q8 request

#1
by dkjsnnr1 - opened

Hey, it would be great having an 8bit quantized version of the orca_mini_v2_ger_7b-GGML available. πŸ™Œ

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment