Skip to content

v0.11.0

Latest

Choose a tag to compare

@github-actions github-actions released this 23 Oct 01:42
· 6 commits to main since this release
Immutable release. Only release title and notes can be modified.

What's new

  • Up to 44 % less CPU: both models now run on DPDFNet's W7A8 runtime, which uses AVX-VNNI on CPUs that have it (Intel since Alder Lake, AMD since Zen 5). Thanks @danielr55 for the runtime and @varyagnord for the AVX-VNNI support!
i7-13700KF, per 10 ms hop v0.10 (INT8) v0.11 (W7A8)
Quality model, P-core 1.30 ms 0.72 ms −44 %
Quality model, E-core 3.63 ms 2.35 ms −35 %
Light model, P-core 0.52 ms 0.31 ms −40 %
Light model, E-core 1.33 ms 0.92 ms −31 %
  • hushmic status now names the engine as native w7a8 avx-vnni or native w7a8 avx2, also in status --json (was native int8).

Compatibility — x86-64, glibc 2.35+ (Ubuntu 22.04, Debian 12, and newer). Tested on Ubuntu, Debian, Fedora, Arch, Linux Mint, Kubuntu, and Kinoite.

Upgrading — re-download the AppImage, apt install the new .deb, or re-run the install script; your ~/.config/hushmic settings are kept. If you enabled the systemd unit, restart it afterwards: systemctl --user restart hushmic.service.

Verify — each artifact's SHA-256 is in sha256sums.txt below; the install script checks it automatically.

Full changelog: v0.10.4...v0.11.0