Skip to content

v0.2.9

Choose a tag to compare

View all tags
@alityb alityb released this 05 Apr 23:14
· 12 commits to master since this release
v0.2.9
4e0fc77

serve-profile timing correlation and startup hardening.

Highlights:

  • inject stable hotpath request IDs and canonicalize vLLM v1 randomized internal IDs back to those external IDs
  • parse only the current run log tail so old requests do not contaminate timing correlation
  • wait through a short external endpoint startup grace window before failing localhost demo runs
  • start the Qwen demo server with --enable-log-requests and fail fast if port 8000 is already owned by another process
Assets 2
Loading