Phi-4-mini-instruct-heretic-GGUF
GGUF quantizations of richardyoung/Phi-4-mini-instruct-heretic, a Heretic abliteration of microsoft/Phi-4-mini-instruct.
| Metric (Heretic evaluation) | Value |
|---|---|
| KL divergence from the original | 0.0378 |
| Refusals | 5/100 |
Reproducibility information: richardyoung/Phi-4-mini-instruct-heretic/reproduce.
| File | Quant |
|---|---|
Phi-4-mini-instruct-heretic-Q4_K_M.gguf |
Q4_K_M |
Phi-4-mini-instruct-heretic-Q5_K_M.gguf |
Q5_K_M |
Phi-4-mini-instruct-heretic-Q6_K.gguf |
Q6_K |
Phi-4-mini-instruct-heretic-Q8_0.gguf |
Q8_0 |
Ollama: ollama run richardyoung/phi-4-mini-instruct-heretic (default tag Q4_K_M).