Hugging Peers

NuExtract3-mlx-4bits

☆ Save
by numind mlx
289 downloads 2 likes on Hugging Face updated

Model card

numind/NuExtract3-mlx-4bits

MLX quantized version of numind/NuExtract3.

Quantization

  • mode: affine
  • group_size: 64
  • bits: 4
  • dtype: source/default
  • quant_predicate: none

Usage

pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-4bits --prompt "your prompt"