Forgotten-Safeword-12B-V3.0-EXL2
This repository contains exl2 quants of Forgotten-Safeword-12B-V3.0, each in respective branch.
Built-in(default) calibration dataset is used.
Download:
To download, open directory you want to download to in your shell/CLI, then use huggingface-cli:
8bpw:
huggingface-cli download riveRiPH/Forgotten-Safeword-12B-V3.0-EXL2 --local-dir Forgotten-Safeword-12B-V3.0-8bpw-h8-exl2 --local-dir-use-symlinks False --revision 8bpw
6bpw:
huggingface-cli download riveRiPH/Forgotten-Safeword-12B-V3.0-EXL2 --local-dir Forgotten-Safeword-12B-V3.0-6bpw-h8-exl2 --local-dir-use-symlinks False --revision 6bpw
5bpw:
huggingface-cli download riveRiPH/Forgotten-Safeword-12B-V3.0-EXL2 --local-dir Forgotten-Safeword-12B-V3.0-5bpw-h8-exl2 --local-dir-use-symlinks False --revision 5bpw
4bpw:
huggingface-cli download riveRiPH/Forgotten-Safeword-12B-V3.0-EXL2 --local-dir Forgotten-Safeword-12B-V3.0-4bpw-h8-exl2 --local-dir-use-symlinks False --revision 4bpw
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model authors have turned it off explicitly.
Model tree for riveRiPH/Forgotten-Safeword-12B-V3.0-EXL2
Base model
ReadyArt/Forgotten-Safeword-12B-V3.0