DeepSeek-R1-0528-Qwen3-8B-heretic-GGUF
GGUF quantizations of richardyoung/DeepSeek-R1-0528-Qwen3-8B-heretic, a Heretic abliteration of deepseek-ai/DeepSeek-R1-0528-Qwen3-8B.
| Metric (Heretic evaluation) | Value |
|---|---|
| KL divergence from the original | 0.0413 |
| Refusals | 4/100 |
Reproducibility information: richardyoung/DeepSeek-R1-0528-Qwen3-8B-heretic/reproduce.
| File | Quant |
|---|---|
DeepSeek-R1-0528-Qwen3-8B-heretic-Q4_K_M.gguf |
Q4_K_M |
DeepSeek-R1-0528-Qwen3-8B-heretic-Q5_K_M.gguf |
Q5_K_M |
DeepSeek-R1-0528-Qwen3-8B-heretic-Q6_K.gguf |
Q6_K |
DeepSeek-R1-0528-Qwen3-8B-heretic-Q8_0.gguf |
Q8_0 |
Ollama: ollama run richardyoung/deepseek-r1-0528-qwen3-8b-heretic (default tag Q4_K_M).