SenseVoiceSmall-4bit

44 downloads 0 likes on Hugging Face updated

Model card

SenseVoiceSmall 4bit MLX

This repository is a local 4-bit MLX quantization of mlx-community/SenseVoiceSmall for VTranslator.

Quantization:

  • bits: 4
  • group_size: 64
  • target repo: vanch007/SenseVoiceSmall-4bit

The app expects the standard config.json, model*.safetensors, am.mvn, and tokenizer model files.