Skip to content

Aitra Meter v0.2.1

Choose a tag to compare

View all tags
@stevenphtan stevenphtan released this 15 Jun 02:53
· 43 commits to main since this release
v0.2.1
88fcb54
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

generic-prometheus inference provider — compatible with TGI, SGLang, Ollama, and Triton. Metric names and model label are configurable via environment variables. Implements the full InferenceMetricsProvider interface (ADR 0004).

Added

  • internal/provider/inference/genericprometheus/ — full implementation with configurable metric names
  • Table-driven tests covering metric scraping and model label resolution
Assets 2
Loading