Repository navigation
·
6 commits
to main
since this release
Immutable
release. Only release title and notes can be modified.
What's new
- Up to 44 % less CPU: both models now run on DPDFNet's W7A8 runtime, which uses AVX-VNNI on CPUs that have it (Intel since Alder Lake, AMD since Zen 5). Thanks @danielr55 for the runtime and @varyagnord for the AVX-VNNI support!
| i7-13700KF, per 10 ms hop | v0.10 (INT8) | v0.11 (W7A8) | |
|---|---|---|---|
| Quality model, P-core | 1.30 ms | 0.72 ms | −44 % |
| Quality model, E-core | 3.63 ms | 2.35 ms | −35 % |
| Light model, P-core | 0.52 ms | 0.31 ms | −40 % |
| Light model, E-core | 1.33 ms | 0.92 ms | −31 % |
hushmic statusnow names the engine asnative w7a8 avx-vnniornative w7a8 avx2, also instatus --json(wasnative int8).
Compatibility — x86-64, glibc 2.35+ (Ubuntu 22.04, Debian 12, and newer). Tested on Ubuntu, Debian, Fedora, Arch, Linux Mint, Kubuntu, and Kinoite.
Upgrading — re-download the AppImage, apt install the new .deb, or re-run the install script; your ~/.config/hushmic settings are kept. If you enabled the systemd unit, restart it afterwards: systemctl --user restart hushmic.service.
Verify — each artifact's SHA-256 is in sha256sums.txt below; the install script checks it automatically.
Full changelog: v0.10.4...v0.11.0