Skip to content

QAI AppBuilder (v3.0.0)

Choose a tag to compare

@Zhanwei-WU Zhanwei-WU released this 24 Aug 07:12
· 25 commits to main since this release

QAI AppBuilder(v3.0.0) for QAIRT SDK 2.48.40.260702 Release Notes

OVERVIEW

QAI AppBuilder is an extension of Qualcomm AI Runtime SDK that simplifies
on-device AI deployment on Snapdragon processors. Build and run AI applications
with natural language prompts — no complex coding required.

KEY FEATURES

CORE CAPABILITIES

  • NPU/GPU/CPU Inference: Load and run QNN context binaries (.bin), model
    libraries (.dll), and SNPE DLC (.dlc) files on Snapdragon NPU
  • Dual-Language APIs: Full C++ and Python bindings for flexible integration
  • Cross-Platform Support: Windows on Snapdragon (ARM64) and Linux environments
    with unified API
  • AI-Driven Model Conversion: Convert PyTorch/ONNX models to QNN format
    (FP16/W8A16/W8A8/W4A8) via natural language chat
  • Pre-built Models: Automatically download and run optimized models from
    Qualcomm AI Hub

ADVANCED FEATURES

  • Large Language Models (Genie): Run Llama 3, Qwen 3, Gemma 2 fully offline
    via GenieAPIService (OpenAI-compatible API)
  • Multimodal Support: Vision, speech, text processing (Whisper ASR, MeloTTS,
    PP-OCR, super-resolution, object detection)
  • WebUI Applications: StableDiffusionApp, ImageRepairApp, GenieWebUI — all
    running on-device, no internet required
  • Skill Plugin System: Extend with hot-reloadable plugins via SKILL.md
  • Native & Float I/O: Native (quantized) and float I/O for maximum throughput;
    multi-graph sessions; LoRA adapter support