Qualcomm NPU (QNN, HTP)

This section explains how to run sherpa-onnx on a Qualcomm NPU using QNN with the HTP backend.

You’ll need a device equipped with a Qualcomm SM8350 processor or a newer, more powerful one, such as the SM8450, SM8475, SM8550, SM8650, SM8750, SM8850, and so on.

• Download QNN SDK
  • QNN_SDK_ROOT
• Build sherpa-onnx for Qualcomm NPU
  • Shared libraries
  • Executable files
• Run executables on your phone with adb
  • Download a QNN model
  • Copy files to your phone
    • Copy model files
    • Copy sherpa-onnx executable files
    • Copy sherpa-onnx library files
    • Copy QNN library files
  • Run it !
    • Check files
    • Set environment variable ADSP_LIBRARY_PATH
    • Run sherpa-onnx-offline
      • Log of the first run
      • Log of later runs
  • Congratulations
• Build Android examples
  • Pre-built APKs
  • How to build Android examples
    • 1. Build shared libraries
    • 2. Copy QNN libs
    • 3. Download model files
    • 4. Change the code to use our selected model
    • 5. Build the demo