4-bit OmniQuant quantized version of dolphin-2.6-mixtral-8x7b. Note that the embedding and the MoE gate weights are not quantized in this version.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support