A curated reading list on foundation-model-driven embodied agents: reasoning, planning, tool use, spatial memory, execution feedback, and self-improvement.
Focus: papers first published from September 2026 onward. Earlier papers are kept in a collapsed background-reading section. VLA and world-model work is included when it contributes to an agent system or provides a meaningful comparison.
Read the paper collection · 简体中文 · Suggest a paper · RSS
47 curated entries · 44 papers · 2 projects · 1 perspective
46 source-checked · 1 full-review · 0 AI drafts · 263 discovery candidates
Each paper appears once under its primary topic; secondary topics remain visible as tags. English titles link to original sources; Chinese notes and reading cards are available alongside them.
-
BT-Agent: Deploying Onboard Robot Agents with Behavior Trees and Multi-Fidelity Evaluation
2026-10-09 · Reasoning & Planning · Monitoring & Recovery · Benchmarks & Evaluation · Memory & Knowledge
让机载小模型选择行为树技能,由本地检查及时中断异常执行,并用结构化反馈支持重试。
-
NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime
2026-10-07 · Reasoning & Planning · Monitoring & Recovery · Memory & Knowledge · VLA & World Models
让推理、导航执行和监控拥有各自上下文,由运行时分配运动控制权,连接前沿模型与导航 VLA。
-
RobotUse: Allocating Computation, Context, and Decisions
2026-10-04 · Reasoning & Planning · Memory & Knowledge · Monitoring & Recovery · Skills & Code
主 Agent 管目标,子 Agent 在图像中选点和姿态,几何后端执行;跨回合经验沉淀到可更新的操作手册。
-
REMM: Revisable Embodied Memory for Manipulation
2026-10-08 · Memory & Knowledge · Reasoning & Planning · Monitoring & Recovery · VLA & World Models
给冻结 VLA 加一层可撤销的任务记忆:证据变了,依赖它的“已完成”状态也必须重审。
-
Recursive Video In-Context Learning for Agentic Robot
2026-10-05 · Memory & Knowledge · Reasoning & Planning · VLA & World Models · Monitoring & Recovery
把一段任务示范变成可按需查询的层级视频记忆,让 Agent 在接触细节需要时再读取短片。
-
RoboICL: Embodied In-Context Learning with GPT-6 Astra
2026-09-28 · Memory & Knowledge · Monitoring & Recovery · Reasoning & Planning
给冻结的 GPT-6 Astra 配上示范和交互记忆,用上下文适应机器人任务,无需训练机器人专用策略。
-
RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments
2026-10-08 · Skills & Code · Self-improvement · Monitoring & Recovery · Reasoning & Planning
把机器人自我改进组织成分层技能工程:定位负责的分支、局部修复、验证后再复用。
-
Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvement
2026-10-08 · Skills & Code · Memory & Knowledge · Monitoring & Recovery · Self-improvement
让编码智能体离线改进策略库,机器人执行时只运行固定代码,以显式状态连接感知、决策和恢复。
-
PhysEvo: Astra Can Act, Let It
2026-10-06 · Skills & Code · Self-improvement · Monitoring & Recovery · Spatial Understanding
冻结 Astra,让执行 Agent 行动、元 Agent 根据轨迹修订工具和技能,连诊断工具本身也能迭代。
-
Make Code as Policy Great Again: Frontier Agents Write, Call, and Evolve Robot Tools
2026-09-30 · Skills & Code · Reasoning & Planning · Monitoring & Recovery · Self-improvement
把多阶段动作封装成可执行工具,每次工具运行后再由 Agent 根据反馈决定下一步。
- EMHO: EMbodied Agent Harness Optimization via Experience Traces
2026-10-06 · Self-improvement · Monitoring & Recovery · Reasoning & Planning · Skills & Code
冻结具身模型,把执行轨迹变成改进规划、感知工具和失败恢复逻辑的依据。
-
RobotWorld: Benchmarking Multimodal Agents for Robot Use Across Diverse Tasks and Embodiments
2026-10-07 · Benchmarks & Evaluation · Spatial Understanding · Monitoring & Recovery
An 84-task simulation benchmark of multimodal robot-use agents across five domains, with trajectory-level diagnosis of state tracking and recovery failures.
-
Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena
2026-10-01 · Benchmarks & Evaluation · Spatial Understanding · Reasoning & Planning
用几何、空间关系、可供性、规划和操作五个维度,检查前沿 VLM 的局部优势能否转化为完整任务成功。
-
LIBERO-Agent: Evaluating General-Purpose Agents for Direct Embodied Manipulation
2026-09-30 · Benchmarks & Evaluation · Reasoning & Planning · Monitoring & Recovery
让通用 Agent 自己选择观测、处理图像和发出原生机器人命令,拆开评估感知、短程动作与长程组合。
-
An Unexpected Robot Policy: Early Evaluations of GPT-6 Astra on RoboDojo and Beyond
2026-09-21 · Benchmarks & Evaluation · Reasoning & Planning · VLA & World Models
系统测试 GPT-6 Astra 直接充当机器人策略的能力,揭示语义泛化与精细动作之间的明显差距。
Project previews; collection dates are labeled when publication dates are unverified.
-
Physical RSI 1.0: Recursive Self-Harness for Scaling Embodied Skills
added 2026-10-12 · Project preview
A preview system for embodied self-harness: propose changes to skills, memory and tools, evaluate frozen candidates on fresh paired cases, select a survivor and preserve evidence and lineage.
-
LoopROS: A Recursively Self-Evolving Robot Operating System for Agentic Manipulation
added 2026-10-12 · Project preview
An agentic robot runtime combining within-episode observation and action feedback with background consolidation of reusable cross-episode Skills. The official project reports 82/100 successes on a selected ten-task simulation subset; component ablations are ongoing.
Author perspectives and essays, listed separately from experimental papers.
- Robot-Use Agents
2026-09-07 · Phillip Isola · Perspective / essay
Phillip Isola considers robot use as a tool capability of general-purpose agents and its implications for how capabilities spread across robots.
Foundations and earlier work (29 papers)
-
BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulation
2024-10-08 · Reasoning & Planning · Memory & Knowledge · VLA & World Models
-
AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents
2024-01-23 · Reasoning & Planning · Self-improvement
-
VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation
2023-12-06 · Reasoning & Planning · Spatial Understanding
-
SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning
2023-07-12 · Reasoning & Planning · Spatial Understanding · Memory & Knowledge
-
Text2Motion: From Natural Language Instructions to Feasible Plans
2023-03-21 · Reasoning & Planning · Spatial Understanding
-
PaLM-E: An Embodied Multimodal Language Model
2023-03-06 · Reasoning & Planning · Self-improvement
-
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models
2022-12-08 · Reasoning & Planning · Monitoring & Recovery
-
Inner Monologue: Embodied Reasoning through Planning with Language Models
2022-07-12 · Reasoning & Planning · Monitoring & Recovery
-
LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action
2022-07-10 · Reasoning & Planning · VLA & World Models
-
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
2022-04-04 · Reasoning & Planning · VLA & World Models
-
Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents
2022-01-18 · Reasoning & Planning
-
ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning
2023-09-28 · Spatial Understanding · Reasoning & Planning · Memory & Knowledge
-
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
2023-07-12 · Spatial Understanding · Skills & Code · Reasoning & Planning
-
ConceptFusion: Open-set Multimodal 3D Mapping
2023-02-14 · Spatial Understanding · Memory & Knowledge
-
OpenScene: 3D Scene Understanding with Open Vocabularies
2022-11-28 · Spatial Understanding · Self-improvement
-
Visual Language Maps for Robot Navigation
2022-10-11 · Spatial Understanding · Skills & Code · Reasoning & Planning
- 3D-Mem: 3D Scene Memory for Embodied Exploration and Reasoning
2024-11-23 · Memory & Knowledge · Spatial Understanding · Reasoning & Planning
-
Eureka: Human-Level Reward Design via Coding Large Language Models
2023-10-19 · Skills & Code · Self-improvement · VLA & World Models
-
Voyager: An Open-Ended Embodied Agent with Large Language Models
2023-05-25 · Skills & Code · Memory & Knowledge · Self-improvement
-
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models
2022-09-22 · Skills & Code · Reasoning & Planning · Monitoring & Recovery
-
Code as Policies: Language Model Programs for Embodied Control
2022-09-16 · Skills & Code · Reasoning & Planning
- DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignment
2023-07-01 · Monitoring & Recovery · Reasoning & Planning
-
OpenVLA: An Open-Source Vision-Language-Action Model
2024-06-13 · VLA & World Models · Self-improvement
-
Octo: An Open-Source Generalist Robot Policy
2024-05-20 · VLA & World Models · Self-improvement
-
OK-Robot: What Really Matters in Integrating Open-Knowledge Models for Robotics
2024-01-22 · VLA & World Models · Spatial Understanding · Reasoning & Planning
-
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
2023-07-28 · VLA & World Models · Self-improvement
-
CLIPort: What and Where Pathways for Robotic Manipulation
2021-09-24 · VLA & World Models · Spatial Understanding
-
BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation
2024-03-14 · Benchmarks & Evaluation
-
Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots
2023-10-19 · Benchmarks & Evaluation
Reading guide and editorial labels
| Question | Research direction |
|---|---|
| How does a model turn a goal into an executable plan? | Reasoning, planning, code and tools |
| How does an agent retain and use observations? | Spatial state, memory and retrieval |
| How does execution adapt to failures? | Monitoring, feedback and recovery |
| What improves through interaction? | In-context learning and self-improvement |
| How do agents work with learned policies? | Agent–VLA/WAM interfaces |
| What does an experiment actually demonstrate? | Benchmarks, protocols and real-robot evidence |
The website includes source-linked reading notes, original paper figures, method comparison, and landscape/portrait cards for reading and sharing. Publication dates refer to the first arXiv submission; revisions are tracked separately.
Opinion essays are labeled separately and do not count as experimental evidence. Official project previews are listed separately from papers. When a release date is unverified, the website labels the collection date instead; project images retain their original source attribution.
- Source-checked: checked against an original abstract or author source; not necessarily a full-paper review.
- Full review: a paper-specific reading with evidence and limitations.
- AI draft: a machine-assisted reading with page-linked excerpts; still requires editorial verification.
- Discovery candidate: automatically discovered metadata; relevance and claims await review.
Automatically extracted illustrations retain their PDF source and page. A page preview is labeled as such. Results from different evaluation protocols are not presented as a common leaderboard.
Suggestions and corrections are welcome via Issues or pull requests. Please include the paper link, first publication date, author project/code links when available, and a short explanation of its relevance to embodied agents. See contribution guidance.
Paper figures and paper content belong to their respective authors. Please cite the original work. BibTeX exports are reading aids; verify complete author names and publication metadata before submission.