Skip to content

Qwen3-TTS Native v0.1.0

Choose a tag to compare

View all tags
@luka-loehr luka-loehr released this 18 Jul 07:06
· 21 commits to main since this release
v0.1.0
d745ebc

Qwen3-TTS Native v0.1.0

Qwen3-TTS Native is a Rust and CUDA runtime for progressive Qwen3-TTS 1.7B
VoiceDesign inference on NVIDIA DGX Spark. The runtime and image do not include
Python, Node.js, PyTorch, SGLang, vLLM, voice cloning, reference-audio
conditioning, or the retired 0.6B model.

Immutable deployment

ghcr.io/luka-loehr/qwen3-tts-native@sha256:5efbe3143e5d305ae3b82603263a503574da15160691bb6de363becfff5612d6
  • Source commit: d745ebcbaf8014b6053f103470d83595d87878e3
  • Annotated source tag: v0.1.0
  • OCI platform: linux/arm64
  • Model: Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign
  • Model revision: 5ecdb67327fd37bb2e042aab12ff7391903235d3
  • OCI transfer size: 3,871,303,232 bytes
  • Docker-reported local image size in an initially empty content store:
    3,871,309,521 bytes

Deploy only the complete digest reference above. v0.1.0 and latest are
convenience aliases verified to resolve to the same digest; they are not the
deployment identity.

API

  • Progressive multipart PCM16 at 24 kHz mono.
  • Buffered PCM16 WAV.
  • Text plus natural-language voice_description.
  • language=auto or Chinese, English, Japanese, Korean, German, French,
    Russian, Portuguese, Spanish, or Italian.
  • Request UUIDs, bounded cancellation, backpressure, natural-EOS reporting,
    liveness/readiness, capabilities, privacy-safe metrics, and graceful
    shutdown.

Controlled benchmark

The release includes a validated two-round Native-versus-stock-SGLang matrix
on one NVIDIA DGX Spark: B1/B3/B6, 24 warm-ups per cell, 200/210/240 measured
requests per cell, 2,600 successful measured requests overall, 100 ms
telemetry, and no competing CUDA process.

  • Native aggregate RTF across the two accepted rounds was 0.800–0.803 at B1,
    0.641–0.642 at B3, and 0.617–0.618 at B6.
  • Stock SGLang aggregate RTF was 0.497–0.499 at B1, 0.186–0.197 at B3, and
    0.102–0.112 at B6; stock therefore had higher aggregate throughput.
  • Native TTFA p95 was 93.89–95.58 ms at B1, 215.55–216.81 ms at B3, and
    405.38–406.04 ms at B6. Stock completion-buffered TTFA p95 was
    2,691.51–3,145.88 ms across the three profiles.
  • Peak observed GPU unified memory was 5.68 GB for Native and 108.90 GB for
    stock SGLang, approximately a 19.2-fold reduction.

Stock SGLang is completion-buffered and exposes no authoritative EOS metadata;
its TTFA and completion semantics are therefore reported explicitly rather
than presented as equivalent to Native progressive delivery. Performance does
not constitute a human speech-quality claim.

Supply-chain and GPU acceptance

  • BuildKit SPDX SBOM: verified against the immutable OCI index.
  • Maximum SLSA provenance: verified; no credential-like field or private host
    path was present.
  • Embedded CycloneDX Rust SBOM and third-party license report: verified.
  • Gitleaks full-history result: 163 commits scanned, no leaks.
  • Grype high/critical findings: 0 with Grype 0.116.0 and the current database.
  • Keyless Cosign identity:
    https://github.com/luka-loehr/qwen3-tts-native/.github/workflows/sign-ghcr-image.yml@refs/heads/main;
    issuer https://token.actions.githubusercontent.com; workflow run
    29634701244 passed exact-claim verification.
  • Pull into a distinct, initially empty Docker content store: passed. After
    publication, a second pull with a completely empty Docker client profile
    also resolved the public package anonymously to the exact release digest.
  • Digest-specific hardened startup: passed as UID 10001:10001, read-only,
    all Linux capabilities dropped, no-new-privileges, PID limit 256.
  • Digest-specific functional smoke: one progressive German request completed
    with exactly one start and one terminal natural-EOS event; one buffered WAV
    completed and passed SoX validation (24 kHz, 16-bit, mono, 5.92 seconds,
    maximum amplitude 0.792145, no clipping). Observed GPU process memory was
    4,821 MiB.
  • Performance acceptance is the already completed 12-cell, 2,600-request
    controlled matrix described above. It was intentionally not repeated during
    tag promotion.

Assets

  • qwen3-tts-native-vs-sglang-stock-dgx-spark-2026-07-17-428307c-report.pdf
  • qwen3-tts-native-paper.pdf
  • qwen3-tts-native-paper-arxiv-source.tar.gz
  • qwen3-tts-native-benchmark-evidence-428307c.tar.zst
  • qwen3-tts-native-rejected-benchmark-audits.tar.zst
  • qwen3-tts-native-release-evidence-d745ebc.tar.zst
  • qwen3-tts-native-v0.1.0-sample.wav
  • SHA256SUMS

Scope and limitations

  • Qualified only on the recorded NVIDIA DGX Spark/GB10 software stack.
  • VoiceDesign only; no voice cloning or reference audio.
  • Turkish has no explicit language ID in the pinned checkpoint and is not
    advertised as supported.
  • Transport and systems qualification do not replace subjective listening,
    pronunciation, or instruction-adherence evaluation.
  • The paper is published with the release; submission to arXiv itself remains
    an author-controlled action outside this automated release.
Assets 10
Loading