Hugging Peers

NuExtract3-mlx-8bits

☆ Save
by numind mlx
222 downloads 3 likes on Hugging Face updated

Model card

numind/NuExtract3-mlx-8bits

MLX quantized version of numind/NuExtract3.

Quantization

  • mode: affine
  • group_size: 64
  • bits: 8
  • dtype: source/default
  • quant_predicate: none

Usage

pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-8bits --prompt "your prompt"