Skip to content

v0.4.0: redesigned console

Choose a tag to compare

View all tags
@coyl coyl released this 22 Oct 16:15
· 27 commits to main since this release
v0.4.0
2ffe710
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

ktms-admin 0.4.0: the redesigned console. Pair it with KTMS 0.14.0.

docker pull coyl/ktms-admin:0.4.0   # also published as coyl/llm-proxy-admin:0.4.0

Upgrading from 0.3.x: rename LLM_PROXY_ADDR, LLM_PROXY_ADMIN_KEY and LLM_PROXY_TLS to KTMS_ADDR, KTMS_ADMIN_KEY and KTMS_TLS (the old names still work and log a warning).

Needs KTMS 0.14.0 or later for the tenant and team pages.

Added

  • Redesigned console (Preact and htm, no build step): visual rules builder, key wizard with
    spend caps, usage with team budgets, light and dark themes.
  • Organizations and teams, a team workspace, and team-scoped access for team leads and members.
  • Spend limits for keys and users.
  • Images are signed with keyless cosign and carry an SBOM and provenance.

Changed

  • Settings use the KTMS names: KTMS_ADDR, KTMS_ADMIN_KEY, KTMS_TLS.
  • The image is published as coyl/ktms-admin, and still as coyl/llm-proxy-admin. Images are
    built only for v* tags; latest follows only the newest stable release.

Deprecated

  • LLM_PROXY_ADDR, LLM_PROXY_ADMIN_KEY, LLM_PROXY_TLS: they keep working with a startup
    warning and are removed in 2.0.
Assets 2
Loading