Hugging Peers

NuExtract3-mlx-nvfp4

☆ Save
by numind mlx
43 downloads 2 likes on Hugging Face updated

Model card

numind/NuExtract3-mlx-nvfp4

MLX quantized version of numind/NuExtract3.

Quantization

  • mode: nvfp4
  • group_size: 16
  • bits: 4
  • dtype: source/default
  • quant_predicate: none

Usage

pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-nvfp4 --prompt "your prompt"