Skip to content

Infinity v3.0.1-beta.3

Pre-release
Pre-release

Choose a tag to compare

View all tags
@michaelfeil michaelfeil released this 28 Oct 16:35
· 5 commits to main since this release
v3.0.1-beta.3
0af4f9e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Infinity V3 3.0.1-beta.3 includes configurable service-tier response headers and optional priority billing-token scaling.

  • Set INFINITY_BILLING_HEADERS=x-baseten to emit x-baseten-input-tokens and x-baseten-service-tier (default or priority). Zero priority queue bonus reports default.
  • Set INFINITY_EXPERIMENTAL_MULTIPLIER=1.2 to scale only effective-priority billing-token counts. It is unset by default. Decimal arithmetic is exact and results round up to integer tokens; actual token usage is unchanged.
  • Also includes D3 Ultra checkpoint support and embedding tensor wire-contract clarifications since beta.2.

Images: ghcr.io/michaelfeil/infinity_v3:cpu-3.0.1-beta.3 and ghcr.io/michaelfeil/infinity_v3:nvidia-3.0.1-beta.3 (linux/amd64). Prerelease tags leave stable latest image aliases unchanged.

CPU images use Candle; the NVIDIA images use native LibTorch. Model support differs by backend. See V3 licensing and the scoped package notices.

Assets 2
Loading