Skip to content

First research release (v1) — arXiv:2611.09376

Latest

Choose a tag to compare

@jushengzhang jushengzhang released this 09 Nov 05:01
· 2 commits to main since this release

This is the first research release (v1) for Can LLMs Debug Robots by Editing Their Weights?.

Version 2 and real-robot experiments are in progress. The results in this release come from simulation. See project status.

这是首个开源版本;第二版研究和真机实验正在进行。当前发布的结果来自仿真。

Included

  • Experiment harness, task specifications, and policy backends, with a workspace configuration helper.
  • The evaluated 65-row π₀.₅ payload and compatibility-checking application script.
  • All 16 robot editing transcripts and paired episode evidence, including unsuccessful searches and withdrawn candidates.
  • Audit scripts for the primary and extended results, English/Chinese documentation, and published paper source.

The main edit gives 660 → 704 successes on 765 held-out paraphrases: 48 repairs and 4 regressions. Among 335 instructions containing edited tokens, success rises from 74.3% to 87.5%; the other 430 episodes have zero binary outcome changes. This refers to success/failure, not identical trajectories. Archived candidates are distinguished from the editor's final decision and from whether cleanup actually executed.

Read or reproduce

Start at the repository home, browse the 16 session guides, or follow the reproduction guide.

Checks performed for the release: both evidence audits, five configured domain imports, source syntax, the actual 65-row payload's dry-run compatibility check and mismatch rejection, and a credential scan. Packaging did not run new robot rollouts. No RoboDojo improvement is claimed.

Downloads and provenance

The tag v0.1.0 identifies the initial code snapshot. Documentation continues on main. The attached paper.pdf and arxiv-source.zip are synchronized from official arXiv v1. SHA256SUMS covers all five payload files. GitHub also provides source archives for the tagged code; the attached edit, evidence, and transcript ZIPs offer smaller downloads.

Original code: Apache-2.0. Base-model-derived payloads and external dependencies retain their applicable terms; see the repository notices.