| This is a GPTQ 4-bit version of [WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b](https://huggingface.co/Monero/WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b) | |
| Quanitized using commit `df77083` of GPTA-for-LLaMa with the following settings: | |
| ```wikitext2 --wbits 4 --true-sequential --act-order --save_safetensors``` | |
| Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility. | |
| --- | |
| license: other | |
| --- | |