Uploaded model

  • Developed by: akaistormherald
  • License: apache-2.0
  • Finetuned from model : unsloth/zephyr-sft-bnb-4bit

Mistral7b + SFT + 4bit DPO training with unalignment/toxic-dpo-v0.2 == ToxicMist? ☣🌫 (GGUF)

Downloads last month
11
GGUF
Model size
7.24B params
Architecture
llama

4-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for akaistormherald/ToxicMist-v0.2-7B-DPO-gguf

Quantized
(4)
this model

Dataset used to train akaistormherald/ToxicMist-v0.2-7B-DPO-gguf