Skip to content

Releases: jungledesh/profile

v2.2.2

Choose a tag to compare

@github-actions github-actions released this 17 Aug 00:43
0bfdda2

Install profile 2.2.2

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.2.2/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.2.2/profile-installer.ps1 | iex"

Download profile 2.2.2

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

v2.2.1

Choose a tag to compare

@github-actions github-actions released this 13 Aug 01:32

Install profile 2.2.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.2.1/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.2.1/profile-installer.ps1 | iex"

Download profile 2.2.1

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

v2.2.0

Choose a tag to compare

@github-actions github-actions released this 12 Aug 23:50
f00093d

Install profile 2.2.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.2.0/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.2.0/profile-installer.ps1 | iex"

Download profile 2.2.0

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

v2.1.4

Choose a tag to compare

@github-actions github-actions released this 19 Jun 00:44
41ab1b4

Install profile 2.1.4

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.1.4/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.1.4/profile-installer.ps1 | iex"

Download profile 2.1.4

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

What's Changed

  • feat: quantization-aware roofline, P95 direction matrix, terminal closure with primary limiter, r3 prompt-throughput gate & more by @jungledesh in #90
  • fix(r5/r1/r2): align issue box display with header — snapshot values, consistent copy, prompt-aware model-len bullet by @jungledesh in #91
  • Final touch to release v2.1.4 by @jungledesh in #92

Full Changelog: https://github.com/jungledesh/profile/commits/v2.1.4

v2.1.3

Choose a tag to compare

@github-actions github-actions released this 12 Jun 16:53
6d218a3

v2.1.3 — closed-loop fixes, model lookup, output cleanup

Loop Fixed stdin race in [r]/[c] regression prompt — was blocking on io::stdin() while the watcher thread held it; now routes through stdin_rx channel.

Model Fixed catalog lookup order — scrape name tried before model_root path, preventing wrong model resolution (e.g. 7B matched instead of 27B).

Output Blank line added after --max-num-seqs prompt. Short-action strings trimmed to primary fix only; full list already shown in the Issues table.

Install profile 2.1.3

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.1.3/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.1.3/profile-installer.ps1 | iex"

Download profile 2.1.3

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

What's Changed

Full Changelog: v2.1.1...v2.1.3

What's Changed

Full Changelog: v2.1.1...v2.1.3

v2.1.2

Choose a tag to compare

@github-actions github-actions released this 11 Jun 03:55

v2.1.2 — Docker distribution, output polish

Docker Published to ghcr.io/jungledesh/profile:latest.
Musl static binary, minimal CUDA base, non-root user.
CI publishes on every v* tag. latest tracks stable releases only.

Output Delta spacing and prompt wording tightened.

Install profile 2.1.2

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.1.2/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.1.2/profile-installer.ps1 | iex"

Download profile 2.1.2

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

v2.1.1

Choose a tag to compare

@github-actions github-actions released this 10 Jun 09:40
8627a35

v2.1.1 — --max-num-seqs auto-detection

  • max_num_seqs is now read from vLLM's vllm_max_num_seqs Prometheus gauge. The flag is not required when vLLM exposes it.
  • Pre-flight scrape runs at startup. Prompt only appears when the gauge is absent.
  • Retry loop capped at 4 attempts with a recovery hint.
  • Fixed stdin race in the closed loop that caused the prompt to hang.

Install profile 2.1.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.1.1/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.1.1/profile-installer.ps1 | iex"

Download profile 2.1.1

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

v2.1.0

Choose a tag to compare

@github-actions github-actions released this 09 Jun 21:19

v2.1.0 — Catalog: Qwen3.6-27B, DGX Spark

  • Added Qwen3.6-27B-Instruct to the model catalog.
  • Added DGX Spark (GB10 Grace Blackwell) to the GPU catalog.

Install profile 2.1.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.1.0/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.1.0/profile-installer.ps1 | iex"

Download profile 2.1.0

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

v2.0.0

Choose a tag to compare

@github-actions github-actions released this 09 Jun 02:33
2f7c748

v2.0.0 — Profile v2

Profile is a physics-grounded optimizer for vLLM. It measures live GPU and scheduler telemetry against your hardware's real decode/prefill ceiling and tells you what happened, why it was slow, and exactly what to fix first.

Traffic-gated analysis. Idle servers are ignored. Under load, Profile ranks five production bottlenecks — under-batching, KV cache pressure, prefix reuse, concurrency saturation, OOM risk — and surfaces one prescriptive fix per iteration.

Closed-loop verification. Run profile diagnose, apply the fix, and Profile detects the vLLM restart automatically. It re-measures and reports throughput, latency, efficiency, and cost deltas with a definitive better / worse / plateau signal.

Physics roofline. Compute and memory-bandwidth ceilings per GPU. Efficiency % and headroom against the theoretical maximum — not a guess, a derivable number.

Economics. tok/W, $/1M tok, and joules/token tracked across every iteration.

Zero overhead. Single Rust binary. Scrape-only (NVML + /metrics). Strictly local. No external APIs.

profile diagnose --url http://localhost:8000/metrics --duration 2m

Docs

Install profile 2.0.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/jungledesh/profile/releases/download/v2.0.0/profile-installer.sh | sh

Install prebuilt binaries via powershell script

powershell -ExecutionPolicy Bypass -c "irm https://github.com/jungledesh/profile/releases/download/v2.0.0/profile-installer.ps1 | iex"

Download profile 2.0.0

File Platform Checksum
profile-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
profile-x86_64-apple-darwin.tar.xz Intel macOS checksum
profile-x86_64-pc-windows-msvc.zip x64 Windows checksum
profile-aarch64-unknown-linux-gnu.tar.xz ARM64 Linux checksum
profile-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum
profile-x86_64-unknown-linux-musl.tar.xz x64 MUSL Linux checksum

v0.1.0

Choose a tag to compare

@jungledesh jungledesh released this 14 Apr 19:15
db7429a

v0.1.0 — First release

  • Diagnose vLLM inefficiencies in seconds
  • Detects:
    • Under-batching
    • KV cache pressure
    • Low prefix cache reuse
  • Supports snapshot + duration analysis

Quick start:
./profile diagnose --url http://localhost:8000/metrics --duration 5m