LinML v0.5.0

LinML 0.5.0 adds TensorRT-RTX on Linux aarch64 (SBSA), makes provider selection and discovery consistent across commands, and changes a few CLI behaviors (see Behavior changes).

Highlights

• TensorRT-RTX on Linux aarch64 (SBSA). NVIDIA's TensorRT-RTX 1.6 supports Ubuntu 24.04 SBSA. On aarch64 hosts LinML now selects the aarch64 wheel (manylinux_2_35, the same EP 0.4.0 and bundled TensorRT-RTX 1.6.1 runtime). It installs to ep-plugins/trt-rtx-arm64/, beside the x86_64 build. The catalog and the fetch script refuse a glibc older than 2.35 before downloading.
• Standalone plugin downloads. TensorRT-RTX and MIGraphX install from curl, sha256sum and unzip commands, without cloning the repository. See Plugin Execution Providers in the README.

Behavior changes

• requestedProvider is null when no --provider is given. run, serve and --profile report requested: auto in text output. Auto selection never counts as a fallback.
• A failed explicit --provider X falls back to CPU, not to another accelerator such as TensorRT.
• Usage errors exit with code 2, as documented. Missing or unknown options print one message instead of the full help.

Fixed

• providers list matches doctor: catalog plugins are registered before discovery, so trt-rtx and OpenVINO appear. A plugin with no EP devices is marked as such. providers list also gained --root.
• catalog list reads plugin status after the resolvable plugins are registered, so a working trt-rtx reads Ready. catalog install prints the active library when it differs from the installed one.
• doctor --model: the smoke Load phase counts plugin EP devices, and each provider gets its catalog libraries. trt-rtx no longer reads NOT READY in smoke mode.
• Readiness messages: a plugin that is loaded but has no devices says so, and no longer suggests a missing library.
• serve --port answers on http://localhost:<port> as well as 127.0.0.1.
• --json is listed once per command, and the global option works before or after the subcommand.
• --version reports the 0.5 line.

Install

Pre-built archives are on this page: linml-0.5.0-linux-x64.tar.gz and linml-0.5.0-linux-arm64.tar.gz. Check them against SHA256SUMS.txt:

sha256sum -c SHA256SUMS.txt --ignore-missing

Not verified

• The aarch64 TensorRT-RTX plugin has not been run on aarch64 hardware. The aarch64 CI job runs the test suite, but it has no GPU.
• The MIGraphX plugin's positive path (an AMD GPU with ROCm) has not been run; its unit tests and the download checks pass.

---

What's Changed

• Fix CLI provider labels, discovery parity, and MIGraphX gating, QNN wiring by @tonythethompson in #32
• Support TensorRT-RTX on Linux aarch64 (SBSA) by @tonythethompson in #33

Full Changelog: v0.4.2...v0.5.0