README.md

metadata

license: gemma
library_name: transformers
pipeline_tag: image-text-to-text
base_model: google/gemma-3-4b-it

Gemma 3 abliterated

This is Gemma 3 4b with [abliteration technique] (https://www.lesswrong.com/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction) applied to reduce refusals. (with high scale_factor=2.0 as it was very stubborn originally)

Tested its work in VLLM. It does give the disclaimers sometimes, but more or less often executes the instructions as needed, and the disclaimers are less aggressive.