Hugging Peers

PiperTTS-DE

☆ Save
by Qualcomm-AI-Hub mit
0 downloads 0 likes on ModelScope updated

Model card

PiperTTS-DE: Optimized for Qualcomm Devices

PiperTTS is a high-quality multi-lingual text-to-speech library.

This is based on the implementation of PiperTTS-DE found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
VOICE_AI float Snapdragon® X2 Elite QAIRT 2.45 Download
VOICE_AI float Snapdragon® X Elite QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Gen 3 Mobile QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Gen 1 Mobile QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA8775P QAIRT 2.45 Download
VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA7255P QAIRT 2.45 Download
VOICE_AI float Qualcomm® SA8295P QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Elite Mobile QAIRT 2.45 Download
VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit PiperTTS-DE on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for PiperTTS-DE on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.audio_generation

Model Stats:

  • Max decoded sequence length: 64 tokens
  • Model checkpoint: rhasspy/piper-checkpoints
  • Model size (decoder) (float): 6.37 MB
  • Model size (encoder) (float): 28.7 MB
  • Model size (flow) (float): 28.2 MB
  • Model size (sdp) (float): 6.61 KB
  • Model size (t5_decoder) (float): 21.8 MB
  • Model size (t5_encoder) (float): 57.5 MB
  • Number of parameters (decoder): 1.66M
  • Number of parameters (encoder): 7.51M
  • Number of parameters (flow): 7.39M
  • Number of parameters (sdp): 1.04K
  • Number of parameters (t5_decoder): 5.72M
  • Number of parameters (t5_encoder): 15.1M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
charsiu_decoder VOICE_AI float Snapdragon® X2 Elite 0.394 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® X Elite 0.444 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 0.313 ms 0 - 8 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 0.576 ms 1 - 10 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 0.58 ms 1 - 4 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.409 ms 0 - 1 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8775P 0.65 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8650P 0.65 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8255P 0.65 ms 0 - 9 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® QCS8450 0.576 ms 1 - 10 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 0.524 ms 3 - 5 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 0.444 ms 1 - 1 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 0.273 ms 0 - 14 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA7255P 0.999 ms 0 - 8 MB NPU
charsiu_decoder VOICE_AI float Qualcomm® SA8295P 0.803 ms 0 - 6 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Elite Mobile 0.273 ms 0 - 14 MB NPU
charsiu_decoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 0.263 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® X2 Elite 0.618 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® X Elite 1.061 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 0.635 ms 0 - 7 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 1.338 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 1.081 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 0.901 ms 0 - 1 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8775P 1.255 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8650P 1.255 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8255P 1.255 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® QCS8450 1.338 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 1.125 ms 0 - 2 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 1.061 ms 0 - 0 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 0.522 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA7255P 2.783 ms 0 - 10 MB NPU
charsiu_encoder VOICE_AI float Qualcomm® SA8295P 1.716 ms 0 - 5 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Elite Mobile 0.522 ms 0 - 9 MB NPU
charsiu_encoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 0.492 ms 0 - 8 MB NPU
decoder VOICE_AI float Snapdragon® X2 Elite 2.755 ms 0 - 0 MB NPU
decoder VOICE_AI float Snapdragon® X Elite 3.069 ms 0 - 0 MB NPU
decoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 2.168 ms 0 - 7 MB NPU
decoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 4.391 ms 0 - 10 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 3.424 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.019 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® SA8775P 3.477 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® SA8650P 3.477 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® SA8255P 3.477 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® QCS8450 4.391 ms 0 - 10 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 3.324 ms 0 - 2 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 3.069 ms 0 - 0 MB NPU
decoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 1.896 ms 0 - 14 MB NPU
decoder VOICE_AI float Qualcomm® SA7255P 8.077 ms 0 - 9 MB NPU
decoder VOICE_AI float Qualcomm® SA8295P 3.966 ms 0 - 5 MB NPU
decoder VOICE_AI float Snapdragon® 8 Elite Mobile 1.896 ms 0 - 14 MB NPU
decoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 1.825 ms 0 - 9 MB NPU
encoder VOICE_AI float Snapdragon® X2 Elite 18.68 ms 0 - 0 MB NPU
encoder VOICE_AI float Snapdragon® X Elite 29.91 ms 0 - 0 MB NPU
encoder VOICE_AI float Snapdragon® 8 Gen 3 Mobile 23.662 ms 0 - 8 MB NPU
encoder VOICE_AI float Snapdragon® 8 Gen 1 Mobile 38.348 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 30.073 ms 0 - 3 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 30.304 ms 0 - 1 MB NPU
encoder VOICE_AI float Qualcomm® SA8775P 32.898 ms 0 - 5 MB NPU
encoder VOICE_AI float Qualcomm® SA8650P 32.898 ms 0 - 5 MB NPU
encoder VOICE_AI float Qualcomm® SA8255P 32.898 ms 0 - 5 MB NPU
encoder VOICE_AI float Qualcomm® QCS8450 38.348 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 32.29 ms 0 - 3 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 29.91 ms 0 - 0 MB NPU
encoder VOICE_AI float Qualcomm® Dragonwing™ Q-8750 19.08 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA7255P 47.216 ms 0 - 9 MB NPU
encoder VOICE_AI float Qualcomm® SA8295P 35.244 ms 0 - 6 MB NPU
encoder VOICE_AI float Snapdragon® 8 Elite Mobile 19.08 ms 0 - 9 MB NPU
encoder VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 17.057 ms 0 - 9 MB NPU
flow VOICE_AI float Snapdragon® X2 Elite 9.611 ms 4 - 4 MB NPU
flow VOICE_AI float Snapdragon® X Elite 16.017 ms 4 - 4 MB NPU
flow VOICE_AI float Snapdragon® 8 Gen 3 Mobile 11.007 ms 4 - 12 MB NPU
flow VOICE_AI float Snapdragon® 8 Gen 1 Mobile 18.187 ms 4 - 14 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 17.611 ms 4 - 11 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 15.128 ms 8 - 9 MB NPU
flow VOICE_AI float Qualcomm® SA8775P 17.347 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA8650P 17.347 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA8255P 17.347 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® QCS8450 18.187 ms 4 - 14 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 17.407 ms 4 - 10 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 16.017 ms 4 - 4 MB NPU
flow VOICE_AI float Qualcomm® Dragonwing™ Q-8750 8.941 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA7255P 39.991 ms 1 - 10 MB NPU
flow VOICE_AI float Qualcomm® SA8295P 18.805 ms 0 - 5 MB NPU
flow VOICE_AI float Snapdragon® 8 Elite Mobile 8.941 ms 1 - 10 MB NPU
flow VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 8.942 ms 3 - 12 MB NPU
sdp VOICE_AI float Snapdragon® X2 Elite 7.157 ms 0 - 0 MB NPU
sdp VOICE_AI float Snapdragon® X Elite 11.398 ms 0 - 0 MB NPU
sdp VOICE_AI float Snapdragon® 8 Gen 3 Mobile 7.704 ms 0 - 8 MB NPU
sdp VOICE_AI float Snapdragon® 8 Gen 1 Mobile 11.283 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-8275 10.452 ms 0 - 3 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ QCS8550 (Proxy) 10.505 ms 1 - 2 MB NPU
sdp VOICE_AI float Qualcomm® SA8775P 11.21 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® SA8650P 11.21 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® SA8255P 11.21 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® QCS8450 11.283 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-9075 11.306 ms 0 - 2 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ IQ-X7181 11.398 ms 0 - 0 MB NPU
sdp VOICE_AI float Qualcomm® Dragonwing™ Q-8750 6.981 ms 0 - 11 MB NPU
sdp VOICE_AI float Qualcomm® SA7255P 20.717 ms 0 - 10 MB NPU
sdp VOICE_AI float Qualcomm® SA8295P 12.704 ms 0 - 6 MB NPU
sdp VOICE_AI float Snapdragon® 8 Elite Mobile 6.981 ms 0 - 11 MB NPU
sdp VOICE_AI float Snapdragon® 8 Elite Gen 5 Mobile 6.632 ms 0 - 8 MB NPU

License

  • The license for the original implementation of PiperTTS-DE can be found here.

References

Community