Skip to content

Infinity v3.0.0-alpha.7

Pre-release
Pre-release

Choose a tag to compare

View all tags
@michaelfeil michaelfeil released this 20 Oct 16:19
· 5 commits to main since this release
v3.0.0-alpha.7
2ec942e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Changes since alpha.6:

  • Add InfinityFA4 native attention and DeBERTa fusion, with bundles for SM80, SM86, SM89, SM90, SM100, and SM120 (#726).
  • Separate LibTorch encoder classifier readout (#727).
  • Add LibTorch Llama and Qwen token classification (#728).
  • Reduce the LibTorch runtime image by selecting required shared libraries and sharing identical FA4 runtimes across architecture bundles (#729).

CPU and NVIDIA image builds are running asynchronously. Check the workflow for publication and startup-check results:

docker pull ghcr.io/michaelfeil/infinity_v3:nvidia-3.0.0-alpha.7
docker pull ghcr.io/michaelfeil/infinity_v3:cpu-3.0.0-alpha.7

Image builds · Licensing · Full changelog

Assets 2
Loading