Skip to content

Infinity v1 0.0.80 (Python 3.11+)

Choose a tag to compare

View all tags
@michaelfeil michaelfeil released this 09 Nov 03:45
0.0.80
53dd6f2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

The legacy Python v1 server and client now require Python 3.11 or newer. Server CI covers Python 3.11, 3.12, and 3.13 on Linux and Windows. The previous 0.0.79 release remains available for older Python environments.

Changes:

  • Move containers to Ubuntu 24.04 and Python 3.12; the NVIDIA image uses CUDA 12.9.1.
  • Refresh CI tooling and compatible inference dependencies, including NumPy 2 and Torch 2.8.
  • Preserve checkpoint pooling, existing ColPali models, and AMD/BetterTransformer support through compatible dependency bounds. Match ONNX Runtime GPU 1.23 and TensorRT 10.9 to CUDA 12.
  • Fix ONNX loading through symlinked local model directories, including Hugging Face snapshot file symlinks.
  • Isolate client-generation tooling and retain the Python client's existing HTTPX compatibility.

Release automation publishes:

  • PyPI: infinity_emb==0.0.80 and infinity_client==0.0.80.
  • NVIDIA: michaelf34/infinity:0.0.80 for linux/amd64 (CUDA-enabled PyTorch) and linux/arm64 (CPU-only PyTorch).
  • CPU: michaelf34/infinity:0.0.80-cpu for linux/amd64.

The existing 0.0.79 version tags and images remain unchanged. The ARM64 variant continues to use CPU-only PyTorch and does not provide ARM64 CUDA acceleration. CI validated CPU/NVIDIA amd64 container builds; GPU hardware execution was not exercised in CI.

This release belongs to the legacy Python v1 line; v3 releases remain separate.

Full changelog: 0.0.79...0.0.80

Assets 2
Loading