Skip to content

ramjet 0.2.0

Choose a tag to compare

View all tags
@nessie993 nessie993 released this 18 Aug 11:31
· 266 commits to main since this release
v0.2.0
68fb5dc
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Renames the project to ramjet, adds the machine-view dashboard and multi-model serving, and makes the cache-hit ratio reportable against engines that never return prompt_tokens_details.cached_tokens.

See CHANGELOG.md for the full entry.

Images
Load balancer ghcr.io/helixml/ramjet:v0.2.0@sha256:9a7e2a4bc131911beec428393f0a6ccab8fb7f634217e6baffa574483c762dd8
Companion ghcr.io/helixml/ramjet:companion-v0.2.0@sha256:d9411d99be1bc5b78a55a2cdbd4d67490e7822a3ce10e99e5f49555c7f49b357
Rollback target ghcr.io/helixml/ramjet:rust-29d9e92@sha256:e303ed167f2723cec0e2d6f57b027cebfc8efd5f78ecc4b6831d9c31994978a8

Both promoted tags resolve to the same manifests as the qualified rust-68fb5dc / companion-rust-68fb5dc builds, and carry org.opencontainers.image.version=0.2.0 with revision 68fb5dc0111c65c761c040fa0c4ec7beb4c431cc.

Breaking

  • Environment prefix MD_ → RJ_; headers are now X-Ramjet-*; benchmark prefix MINI_DYNAMO_ → RAMJET_.
  • Images publish as ghcr.io/helixml/ramjet.
  • build_engine_sample returns EngineScrape; take .sample for the published shape.

The ds4proxy_ metric prefix is deliberately unchanged for dashboard continuity.

Qualification

572 Rust tests, 476 Python tests, Drone quality plus release pipeline green.

Deployed to node06 (qwen38_27b, 4× vLLM TP2 on 8× RTX PRO 6000) as an LB-only recreate with engines untouched: 4/4 upstreams healthy, /health ok, 2.9s recreate.

The cache-hit fix verified live — the ratio went from permanently absent to 98.46% sourced from engine_prefix_cache, cross-checked against the engines' own counters at 94.4–96.0% per active interval.

Request-generating benchmark gates were not run: node06 carries live production traffic under the cooling moratorium, so acceptance rests on the existing production traffic rather than a synthetic matrix.

Assets 2
Loading