Hugging Peers

PiperTTS-IT

☆ Save
by Qualcomm-AI-Hub mit
0 downloads 0 likes on ModelScope updated

Model card

PiperTTS-IT: Optimized for Qualcomm Devices

PiperTTS is a high-quality multi-lingual text-to-speech library.

This is based on the implementation of PiperTTS-IT found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
VOICE_AI float Snapdragon® X2 Elite QAIRT 2.45 Download
VOICE_AI float Snapdragon® X Elite QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Gen 3 Mobile QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Gen 1 Mobile QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA8775P QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA7255P QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA8295P QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Elite Mobile QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit PiperTTS-IT on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for PiperTTS-IT on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.audio_generation

Model Stats:

  • Max decoded sequence length: 64 tokens
  • Model checkpoint: rhasspy/piper-voices
  • Model size (decoder) (float): 6.37 MB
  • Model size (encoder) (float): 28.7 MB
  • Model size (flow) (float): 28.2 MB
  • Model size (sdp) (float): 6.61 KB
  • Model size (t5_decoder) (float): 21.8 MB
  • Model size (t5_encoder) (float): 57.5 MB
  • Number of parameters (decoder): 1.66M
  • Number of parameters (encoder): 7.51M
  • Number of parameters (flow): 7.39M
  • Number of parameters (sdp): 1.04K
  • Number of parameters (t5_decoder): 5.72M
  • Number of parameters (t5_encoder): 15.1M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
charsiu_decoder VOICE_AI float Snapdragon® X2 Elite 0.342 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® X Elite 0.418 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 0.315 ms 0 - 7 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 0.576 ms 1 - 11 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 0.581 ms 1 - 3 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.396 ms 1 - 2 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8775P 0.652 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8650P 0.652 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8255P 0.652 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® QCS8450 0.576 ms 1 - 11 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 0.517 ms 1 - 3 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 0.418 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 0.27 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA7255P 1.029 ms 0 - 8 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8295P 0.819 ms 0 - 5 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Elite Mobile 0.27 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 0.285 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® X2 Elite 0.632 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® X Elite 1.046 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 0.635 ms 0 - 8 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 1.335 ms 0 - 13 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 1.082 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.893 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8775P 1.27 ms 0 - 5 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8650P 1.27 ms 0 - 5 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8255P 1.27 ms 0 - 5 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® QCS8450 1.335 ms 0 - 13 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 1.122 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 1.046 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 0.527 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA7255P 2.759 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8295P 1.75 ms 0 - 5 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Elite Mobile 0.527 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 0.489 ms 0 - 9 MB NPU
decoder VOICE_AI float Snapdragon® X2 Elite 1.783 ms 0 - 0 MB NPU
decoder VOICE_AI float Snapdragon® X Elite 3.073 ms 0 - 0 MB NPU
decoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 2.164 ms 0 - 8 MB NPU
decoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 4.382 ms 0 - 10 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 3.426 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.016 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® SA8775P 3.483 ms 0 - 5 MB NPU
decoder VOICE_AI float Qualcomm® SA8650P 3.483 ms 0 - 5 MB NPU
decoder VOICE_AI float Qualcomm® SA8255P 3.483 ms 0 - 5 MB NPU
decoder VOICE_AI float Qualcomm® QCS8450 4.382 ms 0 - 10 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 3.335 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 3.073 ms 0 - 0 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 1.894 ms 0 - 8 MB NPU
decoder VOICE_AI float Qualcomm® SA7255P 8.074 ms 0 - 8 MB NPU
decoder VOICE_AI float Qualcomm® SA8295P 3.984 ms 0 - 5 MB NPU
decoder VOICE_AI float Snapdragon® 8 Elite Mobile 1.894 ms 0 - 8 MB NPU
decoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 1.825 ms 0 - 8 MB NPU
encoder VOICE_AI float Snapdragon® X2 Elite 18.623 ms 0 - 0 MB NPU
encoder VOICE_AI float Snapdragon® X Elite 29.96 ms 0 - 0 MB NPU
encoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 23.848 ms 0 - 7 MB NPU
encoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 38.472 ms 0 - 10 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 29.324 ms 0 - 3 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 31.572 ms 0 - 2 MB NPU
encoder VOICE_AI float Qualcomm® SA8775P 32.982 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA8650P 32.982 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA8255P 32.982 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® QCS8450 38.472 ms 0 - 10 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 32.377 ms 0 - 3 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 29.96 ms 0 - 0 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 19.263 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA7255P 47.013 ms 0 - 10 MB NPU
encoder VOICE_AI float Qualcomm® SA8295P 35.195 ms 0 - 6 MB NPU
encoder VOICE_AI float Snapdragon® 8 Elite Mobile 19.263 ms 0 - 9 MB NPU
encoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 17.077 ms 0 - 8 MB NPU
flow VOICE_AI float Snapdragon® X2 Elite 9.622 ms 4 - 4 MB NPU
flow VOICE_AI float Snapdragon® X Elite 16.048 ms 4 - 4 MB NPU
flow VOICE_AI float Snapdragon® 8 Gen 3 Mobile 11.066 ms 4 - 11 MB NPU
flow VOICE_AI float Snapdragon® 8 Gen 1 Mobile 18.273 ms 4 - 13 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 17.605 ms 4 - 11 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 14.919 ms 4 - 5 MB NPU
flow VOICE_AI float Qualcomm® SA8775P 17.32 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA8650P 17.32 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA8255P 17.32 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® QCS8450 18.273 ms 4 - 13 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 17.688 ms 4 - 10 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 16.048 ms 4 - 4 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ Q-8750 8.917 ms 3 - 11 MB NPU
flow VOICE_AI float Qualcomm® SA7255P 39.817 ms 1 - 9 MB NPU
flow VOICE_AI float Qualcomm® SA8295P 18.822 ms 0 - 5 MB NPU
flow VOICE_AI float Snapdragon® 8 Elite Mobile 8.917 ms 3 - 11 MB NPU
flow VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 8.973 ms 2 - 10 MB NPU
sdp VOICE_AI float Snapdragon® X2 Elite 7.133 ms 0 - 0 MB NPU
sdp VOICE_AI float Snapdragon® X Elite 11.413 ms 0 - 0 MB NPU
sdp VOICE_AI float Snapdragon® 8 Gen 3 Mobile 7.738 ms 0 - 7 MB NPU
sdp VOICE_AI float Snapdragon® 8 Gen 1 Mobile 11.236 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 10.428 ms 0 - 3 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 10.51 ms 0 - 2 MB NPU
sdp VOICE_AI float Qualcomm® SA8775P 11.179 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® SA8650P 11.179 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® SA8255P 11.179 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® QCS8450 11.236 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 11.347 ms 2 - 4 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 11.413 ms 0 - 0 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ Q-8750 6.981 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® SA7255P 20.719 ms 0 - 9 MB NPU
sdp VOICE_AI float Qualcomm® SA8295P 12.686 ms 0 - 5 MB NPU
sdp VOICE_AI float Snapdragon® 8 Elite Mobile 6.981 ms 0 - 10 MB NPU
sdp VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 6.625 ms 0 - 9 MB NPU

License

  • The license for the original implementation of PiperTTS-IT can be found here.

References

Community