rnj-1-instruct-nvfp4

25 downloads 0 likes on Hugging Face updated

Model card

This is EssentialAI/rnj-1-instruct quantized with LLM Compressor with the recipe in the "recipe.yaml" file. The model is compatible with vLLM (tested: v0.12.0). Tested with an RTX 5090.

How to Support My Work

Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free. Or you can "buy me a kofi".