Pygmalion 7B (q5_0 ggml version)

Converted from the XORed weights from PygmalionAI (i.e. ready for use).
Additionally, converted from bfloat16 to float16.
Additionally, converted from float16 to ggml float16.
Additionally, quantized from ggml float16 to ggml q5_0.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.