Quants requests
#2
by
Nexesenex
- opened
Hey, Romain.
Here are some 70b models I'd like to toy with and which could be pertinent to quantize :
- https://huggingface.co/ChuckMcSneed/Gembo-v1-70b
- https://huggingface.co/sophosympatheia/Midnight-Rose-70B-v2.0.3
On my side, I'm on another Wintergoddess 70b 32k and some 34b quants.
Merci beaucoup, Romain!