numind/NuExtract3-mlx-5bits

MLX quantized version of numind/NuExtract3.

Quantization

• mode: affine
• group_size: 64
• bits: 5
• dtype: source/default
• quant_predicate: none

Usage

pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-5bits --prompt "your prompt"