Hugging Face's logo

castorini
/
rank_zephyr_7b_v1_full

Text Generation
Transformers
Safetensors
English
mistral
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
4

Quantized models?

#1
by ClassicRob - opened
Discussion
ClassicRob

Hi! I would really love to use this locally, any chance we can get quantized versions of this? Thank you!

ronak
 Castorini org

Stay tuned!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment