ramjet 0.4.0

Idle drain grows an actuator

• RJ_IDLE_DRAIN_ACTUATOR=sleep lets the LB carry out its own park decision through vLLM sleep mode (POST /sleep / POST /wake_up). Actuation is gated on drain mode; observe remains consequence-free. A parked or waking replica stays fenced from routing, because a sleeping vLLM engine hangs rather than refuses.
• RJ_IDLE_DRAIN_RELEASE=utilization releases an individually quiet replica while its peers serve. RJ_IDLE_DRAIN_MAX_PARKED bounds host memory: level-1 sleep does not return offloaded weights on wake.

Serving recipes

• deploy/qwen38_27b/ documents two qualified stacks: the vLLM FP8+MTP topology family (full feature surface) and the SGLang NVFP4+DFlash2 overlay (eight single-GPU engines, fastest single-stream decode). Both serve the same model name. The SGLang tool-call parser must be qwen3_coder — the qwen name is the Qwen2.5 JSON detector and silently swallows Qwen3.8's XML tool calls.

Machine view

• Gen tok/s tile shows a 30s mean instead of a 30s max (completion-tick spikes read as rates the fleet never sustained).
• New per-stream decode quantiles (stream_tps_p50/stream_tps_p05) from the per-request ramjet_decode_tokens_per_second histogram, with a Stream tok/s tile.
• Tile sparkline hover is confined to the chart's own bounds.

Images

• ghcr.io/helixml/ramjet:v0.4.0@sha256:467e7edf40c8fcad29e741cbba52ca571cbae0261d94cff008aa6bcdb737ea1b
• ghcr.io/helixml/ramjet:companion-v0.4.0@sha256:6d00646e40c0a3fed78b8a33d8136e52a0c46f0d5287c84bca00e61f22474d34

Qualified on node06 (build 513 → deployed by digest → tag build 514 promoted with digest equality). Rollback target: ghcr.io/helixml/ramjet:v0.3.0@sha256:2489110adbed61b7a2a415784d817d48803c234c97509fd2e0eb180c5e7453b3.

🤖 Generated with Claude Code