Skip to content

v0.1.69

Choose a tag to compare

View all tags
@sheepdestroyer sheepdestroyer released this 05 Sep 00:21
· 29 commits to master since this release
v0.1.69
707bdd9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Release v0.1.69: LiteLLM Client Auth Log Reclassification & Negative Key Caching

  • LiteLLM Client Auth Reclassification: Added ClientAuthLogFilter and MinLevelFilter in litellm/entrypoint.py to reclassify client 401/404 authentication and virtual key lookup failures from ERROR to WARNING.
  • Traceback Suppression: Strips redundant multi-line Python tracebacks from client auth errors so they produce clean, single-line [WARNING] events routed to stdout. Real server and upstream LLM provider errors retain full [ERROR] severity and tracebacks.
  • Virtual Key Negative Caching: Added bounded negative cache in router/main.py (_INVALID_VIRTUAL_KEY_CACHE, 60s TTL, max 5000 entries with FIFO eviction) for 400/404/blocked keys to prevent repeated hammering of /key/info.
  • Master Key Rejection Telemetry: Differentiates 401/403 responses from LiteLLM /key/info, explicitly logging master key rejections as [ERROR] without polluting the client negative key cache.
Assets 3
Loading