Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

4.5bpw EXL2 quant of https://huggingface.co/TheDrummer/Cydonia-22B-v1.3

6bit heads. Default measurement dataset.

Downloads last month
13
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.