Qwen3-8B-Abliterated-GGUF
GGUF quantized versions of richardyoung/Qwen3-8B-Abliterated.
Available Quantizations
| File | Size | Description |
|---|---|---|
| qwen3-8b-abliterated-Q4_K_M.gguf | 4.7 GB | 4-bit quantization (recommended for most use cases) |
Usage with Ollama
ollama run hf.co/richardyoung/Qwen3-8B-Abliterated-GGUF:Q4_K_M
Usage with llama.cpp
./llama-cli -m qwen3-8b-abliterated-Q4_K_M.gguf -p "Your prompt here"
About
This is an abliterated version of Qwen3-8B with reduced safety refusals. See the base model for more details on the abliteration process.
Disclaimer
This model is provided for research purposes only. Users are responsible for ensuring ethical use.