Skip to content

Hyperloom v0.4

Choose a tag to compare

View all tags
@chaojhou chaojhou released this 27 May 01:53
v0.4
aa268ba

Highlights

Hyperloom v2 architecture lands

v0.4 is a substantial v2 leap: end-to-end Model Auto-Optimize, Framework Agent integration, Agent Kernel Arena, the Self-Evolving Skills & Memory layer ramping past the v0.3 proposal-only stage, and the first-iteration Hyperloom Knowledge Base Service. Multi-Node CI/CD comes online as a first-class capability.

Robustness Agent overhaul

A foundation rewrite ships 13 independent signal detectors (preflight, kernel-pipeline, gpu-leak, decision-audit, critic-health, budget, state-integrity, repeated-payload, aiter-jit, external-deps, progress, event, local-health), an action ladder for graduated response, run finalize / postmortem, and a persistent state store. Closes long-standing issues like SQLite corruption on multi-day runs, validate_stack retry / TP miscalibration, and arbor orchestrator silent exits.

TraceLens ↔ GEAK integration tightened

Multi-root InferenceX patcher with post-profile trace structure validation; SGLang 0.5.11 patch parity (alongside 0.5.9); TraceLens prose + source-function aggregation surfaced to GEAK during kernel rewrite; duplicate-markdown and standalone-upload bugs resolved. Server patcher robustness landed in two follow-up rounds.

GEAK Quick vs Full mode

GEAK now supports a Quick (latency-first) vs Full (deeper search) mode, and on the recipe side learns to recommend kernel-fusion opportunities. Old 1.50x early-exit and hard-coded homogeneous-mode hints in the kernel-optimization prompt are obsoleted.

Critic Agent (first iteration)

A new Critic Agent backend ships with decision reviewer, prompt builder, robustness priors, and web-search support for evidence retrieval during decision review.

CI / Automation

Issue ball-tracker and stale-issue auto-management workflows ship; CI scheduling is hardened (top-2000 candidate pool, GLM5 remote mode, Windows-safe NFS_ROOT, per-run optimization-result publishing).

What's included in this release

Hyperloom v2 architecture

  • Hyperloom v2: Multi-Node Support ( #162 )
  • Hyperloom v2: Multi-Node CI/CD ( #163 )
  • Model Auto-Optimize ( #164 ) and Visualization ( #165 )
  • Hyperloom Framework Agent ( #166 )
  • Hyperloom v2: Integrate with Framework Agent ( #167 )
  • Agent Kernel Arena Integration ( #168 )
  • Self-Evolving Skills & Memory v0.4 ( #169 )
  • Hyperloom Knowledge Base Service ( #171 )

TraceLens / Profiling

  • Multi-root InferenceX patcher + post-profile trace structure validator ( #210 )
  • TraceLens v0.3.1 per-version SGLang patch subdirs (0.5.9 / 0.5.11)
  • Surface TraceLens prose + source-function aggregation to GEAK ( #204 )
  • Follow-up to #194 / PR #200: 6 robustness gaps in TraceLens server patcher ( #205 )
  • TraceLens triple-duplicate markdown fix ( #203 / #209 )
  • TraceLens Standalone Analysis upload error ( #220 )
  • TraceLens analysis FileNotFoundError on pre-restructure checkouts ( #250 )
  • New TraceLens v0.3.1 ( #255 ) — superseded by per-version patches

Robustness Agent

  • Action ladder + RCA engine + finalize / postmortem + persistent state store
  • Signal detectors: preflight, kernel-pipeline, gpu-leak, decision-audit, critic-health, budget, state-integrity, repeated-payload, aiter-jit, external-deps, progress, event, local-health
  • SQLite DB corruption fix during long runs ( #242 )
  • validate_stack stop retrying after N consecutive failures ( #245 )
  • validate_stack wrong TP when user pins GPU subset via ROCR_VISIBLE_DEVICES ( #248 )
  • arbor dfs orchestrator silent exit fix ( #275 )
  • arbor recipe filename uses model name (not dir basename) ( #254 )

GEAK

  • Integrate GEAK Quick vs Full mode ( #196 )
  • Recommend kernel-fusion opportunities for GEAK optimization ( #195 )
  • Obsolete 1.50x early-exit + hard-coded homogeneous-mode hints from kernel-optimization prompt ( #260 )

Critic Agent

  • Critic Agent backend (decision reviewer + prompt builder + robustness priors)
  • Web search support for evidence retrieval during decision review ( #170 )

Onboarding / Local Mode / Install

  • Local-mode setup script local_setup.sh ( #208 )
  • install.sh hardening: /opt/venv preference + ROCm-torch wheel gate + old-pip detection + PYTHON/PATH threading ( #232 )
  • Ship optimizer_runs/robustness_monitor.sh.example ( #233 )
  • GEAK config rendered by install.sh now includes run.budgets block ( #246 )

Multi-node + resource scheduling

  • Time-multiplex GPUs between model and agents — TP=8 single-node optimization ( #253 )

UI & Reporting

  • Final report and log files download flow restored ( #219 )
  • OOB: Cursor as a backend option ( #143 )
  • Roofline metrics on the dashboard ( #283 )

Errors / Permissions

  • Core42 "user not allowed to create workload" ( #202 )
  • LLM Gateway Binding failed — Primus.00001 internal error ( #256 )

CI / Automation

  • Issue ball-tracker + stale-issue auto-management workflows
  • CI: top-2000 candidate pool; GLM5 remote mode (#230); per-run optimization-result publishing; sandbox_image support; harden scheduled model selection / metrics parsing (#235); breakdown collector fixes (#236); tools-injection cleanup + Windows NFS_ROOT (#227); README + .env.template fixes (#228)

Extensibility direction

  • Platform stays as opinionated curated baseline; user-supplied skills and tool enhancements run via local mode (resolved #122 + #106). No platform-side plugin-host / dynamic-skill-selection contract.

Closed as Not Planned (skipped this cycle)

  • Detailed instructions to run Hyperloop in Local Mode ( #231 ) — superseded by local_setup.sh + README Quickstart rewrite

Requirements

  • ROCm platform (tested on MI355X, MI325X, MI300X)
  • Docker with AMD ROCm support, or Kubernetes with AMD GPU nodes
  • Cursor IDE with Remote SSH extension (for local workflows)
  • LLM API key for GEAK kernel optimization
  • OOB API key + base URL for OOB Agent MCP (Claude Code / Codex / Cursor backends)
  • tmux, jq, Node.js >= 18, Claude CLI (@anthropic-ai/claude-code) for the multi-agent runtime
Assets 2
Loading