Hugging Peers

PiperTTS-EN

☆ Save
by Qualcomm-AI-Hub mit
0 downloads 0 likes on ModelScope updated

Model card

PiperTTS-EN: Optimized for Qualcomm Devices

PiperTTS is a high-quality multi-lingual text-to-speech library.

This is based on the implementation of PiperTTS-EN found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
VOICE_AI float Snapdragon® X2 Elite QAIRT 2.45 Download
VOICE_AI float Snapdragon® X Elite QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Gen 3 Mobile QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Gen 1 Mobile QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA8775P QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA7255P QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA8295P QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Elite Mobile QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit PiperTTS-EN on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for PiperTTS-EN on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.audio_generation

Model Stats:

  • Max decoded sequence length: 64 tokens
  • Model checkpoint: rhasspy/piper-checkpoints
  • Model size (decoder) (float): 6.37 MB
  • Model size (encoder) (float): 28.7 MB
  • Model size (flow) (float): 28.2 MB
  • Model size (sdp) (float): 6.61 KB
  • Model size (t5_decoder) (float): 21.8 MB
  • Model size (t5_encoder) (float): 57.5 MB
  • Number of parameters (decoder): 1.66M
  • Number of parameters (encoder): 7.51M
  • Number of parameters (flow): 7.39M
  • Number of parameters (sdp): 1.04K
  • Number of parameters (t5_decoder): 5.72M
  • Number of parameters (t5_encoder): 15.1M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
charsiu_decoder VOICE_AI float Snapdragon® X2 Elite 0.364 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® X Elite 0.432 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 0.301 ms 0 - 8 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 0.579 ms 1 - 10 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 0.56 ms 1 - 3 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.401 ms 0 - 2 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8775P 0.646 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8650P 0.646 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8255P 0.646 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® QCS8450 0.579 ms 1 - 10 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 0.515 ms 1 - 3 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 0.432 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 0.27 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA7255P 0.956 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8295P 0.792 ms 0 - 5 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Elite Mobile 0.27 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 0.259 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® X2 Elite 0.639 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® X Elite 1.039 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 0.64 ms 0 - 8 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 1.333 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 1.082 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.899 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8775P 1.256 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8650P 1.256 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8255P 1.256 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® QCS8450 1.333 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 1.124 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 1.039 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 0.527 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA7255P 2.78 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8295P 1.748 ms 0 - 5 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Elite Mobile 0.527 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 0.487 ms 0 - 8 MB NPU
decoder VOICE_AI float Snapdragon® X2 Elite 1.806 ms 0 - 0 MB NPU
decoder VOICE_AI float Snapdragon® X Elite 3.072 ms 0 - 0 MB NPU
decoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 2.177 ms 0 - 7 MB NPU
decoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 4.356 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 3.424 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.013 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® SA8775P 3.489 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® SA8650P 3.489 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® SA8255P 3.489 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® QCS8450 4.356 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 3.334 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 3.072 ms 0 - 0 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 1.901 ms 0 - 8 MB NPU
decoder VOICE_AI float Qualcomm® SA7255P 8.084 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® SA8295P 3.969 ms 0 - 5 MB NPU
decoder VOICE_AI float Snapdragon® 8 Elite Mobile 1.901 ms 0 - 8 MB NPU
decoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 1.822 ms 0 - 12 MB NPU
encoder VOICE_AI float Snapdragon® X2 Elite 18.634 ms 0 - 0 MB NPU
encoder VOICE_AI float Snapdragon® X Elite 29.31 ms 0 - 0 MB NPU
encoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 23.761 ms 0 - 8 MB NPU
encoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 39.825 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 29.843 ms 0 - 3 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 30.424 ms 0 - 2 MB NPU
encoder VOICE_AI float Qualcomm® SA8775P 32.946 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA8650P 32.946 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA8255P 32.946 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® QCS8450 39.825 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 32.269 ms 2 - 5 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 29.31 ms 0 - 0 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 18.778 ms 0 - 13 MB NPU
encoder VOICE_AI float Qualcomm® SA7255P 47.571 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA8295P 35.188 ms 0 - 6 MB NPU
encoder VOICE_AI float Snapdragon® 8 Elite Mobile 18.778 ms 0 - 13 MB NPU
encoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 17.047 ms 0 - 8 MB NPU
flow VOICE_AI float Snapdragon® X2 Elite 9.642 ms 4 - 4 MB NPU
flow VOICE_AI float Snapdragon® X Elite 15.923 ms 4 - 4 MB NPU
flow VOICE_AI float Snapdragon® 8 Gen 3 Mobile 11.111 ms 4 - 12 MB NPU
flow VOICE_AI float Snapdragon® 8 Gen 1 Mobile 18.268 ms 4 - 14 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 17.32 ms 4 - 11 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 15.034 ms 4 - 5 MB NPU
flow VOICE_AI float Qualcomm® SA8775P 17.291 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA8650P 17.291 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA8255P 17.291 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® QCS8450 18.268 ms 4 - 14 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 17.37 ms 4 - 10 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 15.923 ms 4 - 4 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ Q-8750 8.918 ms 3 - 11 MB NPU
flow VOICE_AI float Qualcomm® SA7255P 39.995 ms 1 - 9 MB NPU
flow VOICE_AI float Qualcomm® SA8295P 18.811 ms 0 - 5 MB NPU
flow VOICE_AI float Snapdragon® 8 Elite Mobile 8.918 ms 3 - 11 MB NPU
flow VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 8.971 ms 3 - 11 MB NPU
sdp VOICE_AI float Snapdragon® X2 Elite 7.153 ms 0 - 0 MB NPU
sdp VOICE_AI float Snapdragon® X Elite 11.26 ms 0 - 0 MB NPU
sdp VOICE_AI float Snapdragon® 8 Gen 3 Mobile 7.74 ms 0 - 8 MB NPU
sdp VOICE_AI float Snapdragon® 8 Gen 1 Mobile 11.322 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 10.426 ms 0 - 3 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 10.462 ms 0 - 2 MB NPU
sdp VOICE_AI float Qualcomm® SA8775P 11.236 ms 0 - 6 MB NPU
sdp VOICE_AI float Qualcomm® SA8650P 11.236 ms 0 - 6 MB NPU
sdp VOICE_AI float Qualcomm® SA8255P 11.236 ms 0 - 6 MB NPU
sdp VOICE_AI float Qualcomm® QCS8450 11.322 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 11.059 ms 2 - 4 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 11.26 ms 0 - 0 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ Q-8750 6.98 ms 0 - 9 MB NPU
sdp VOICE_AI float Qualcomm® SA7255P 20.717 ms 0 - 9 MB NPU
sdp VOICE_AI float Qualcomm® SA8295P 12.711 ms 0 - 5 MB NPU
sdp VOICE_AI float Snapdragon® 8 Elite Mobile 6.98 ms 0 - 9 MB NPU
sdp VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 6.613 ms 0 - 9 MB NPU

License

  • The license for the original implementation of PiperTTS-EN can be found here.

References

Community