Skip to content

Hyperloom v0.8

Choose a tag to compare

View all tags
@chaojhou chaojhou released this 06 Jul 02:57
v0.8
9ea5ea7

Highlights

Kernel-optimization integrity & GEAK faithfulness

Patch-only kernel wins are no longer discarded by the FULL_BENCHMARK verifier
(full source is reconstructed from the patch); multi-file (L3) kernel
optimizations are preserved end-to-end via recorded kernel-artifact bundles;
GEAK always runs against a freshly re-profiled TraceLens snapshot; and the
kernel-candidate pool cap is decoupled from the dispatch budget.

Profiling / roofline / TraceLens

GPU information is restored in profiler traces (torch-trace "kernel"
category), and a stale TRACELENS_ROOT inherited from the kernel-agent env
file no longer breaks TraceLens discovery.

Orchestrator reliability & long-run durability

reports/final.json is now written crash-safe even on non-graceful /
time_exhausted exits, and orchestrator LLM calls survive slow heavy-reasoning
models (e.g. Kimi-K2.6) via idle-timeout + amplified retry.

Server config & Local-Mode portability

sglang --context-length is clamped to the run's --max-model-len (no more
contradictory server config), and Local Mode portability groundwork removes
Core42 / WekaFS hard-coding (docs).

What's included

Kernel-opt & candidates

  • Reconstruct full source from patch so patch-only kernel wins aren't deferred — #681 (closes #680)
  • Record & consume kernel-artifact bundles; preserve multi-file (L3) kernels — #782 (closes #696)
  • Rerun profiling + TraceLens before GEAK to avoid stale snapshots — #686 (closes #688)
  • Decouple kernel-candidate pool cap from dispatch budget — #791† (#667)

Profiling / TraceLens

  • Restore torch-trace "kernel" category so profiler traces carry GPU info — #777 (closes #769)

Server config

  • Clamp sglang --context-length to --max-model-len — #764 (closes #697)

Reporting

  • Crash-safe reports/final.json on non-graceful exit — #763 (closes #464)

Portability (docs)

  • Local Mode portability groundwork — remove Core42 / WekaFS hard-coding — #779† (#767; docs only, bare-metal installer #802 in review)

Related improvements (area addressed by a merged PR; issue closed as not-planned)

  • GEAK landing-rate: op source paths for vLLM v21 / SGLang 0.5.12 (#706†) and trust verified-correctness from timed-out GEAK partial runs (#750†) — (#742)
  • Correct stale inherited TRACELENS_ROOT from the kernel-agent env file — #786† (#722)
  • GEAK_v4 E2E patchability follow-up (apply + remeasure, aiter harness routing, dispatch context) — #703† (#720; also advances #717)
  • Orchestrator idle-timeout + amplified retry for slow reasoning models — #785† (effectively fixes #679)
  • Kernel-artifact-bundle work touching the deterministic-TraceLens / agentic path — #782† (#664)

Requirements

(unchanged from v0.7) ROCm platform (MI355X / MI325X / MI300X; MI308X
detection); Docker with AMD ROCm support, or Kubernetes with AMD GPU nodes;
Cursor IDE + Remote SSH; LLM API key (GEAK); OOB API key + base URL; GBrain
base URL + token (Forge); tmux, jq, Node.js >= 18, Claude CLI.

Assets 5
Loading