Skip to content

2026 05 01 self modifying agent architectures

github-actions[bot] edited this page May 2, 2026 · 1 revision

What are the design tradeoffs of self-modifying, malleable Artificial Intelligence (AI) agent architectures versus fixed-architecture agents?

Research Question

What are the design tradeoffs, in capability, reliability, safety, and maintainability, between self-modifying agent architectures, where the agent can alter its own toolset, prompts, or extensions at runtime, and fixed-architecture agents, where the harness is static and immutable during a session?

Scope

In scope:

  • Definition and taxonomy of self-modification in Artificial Intelligence (AI) agents, including runtime extension loading, hot reload, dynamic tool registration, agent-authored prompts, and agent-authored extensions
  • Claimed benefits of self-modification, including workflow adaptability, personalisation, and emergent capability without forking
  • Claimed risks, including instability, security surface expansion, reproducibility loss, and debugging difficulty
  • Empirical or practitioner evidence for either position from deployed systems
  • Formal safety considerations, including whether a self-modifying agent can safely constrain its own behaviour
  • Comparison across Pi, aider, Claude Code, and OpenCode where the retrieved sources materially document the relevant control surface

Out of scope:

  • Meta-learning and in-weights self-modification during training
  • Recursive self-improvement at the model level
  • Detailed plugin Application Programming Interface (API) design, except where it changes the tradeoff analysis

Constraints:

  • Distinguish narrow runtime surface mutation from broad self-modification of goals or core decision logic
  • Prioritize deployed evidence and first-party documentation over speculative claims
  • Flag where findings rely on creator rationale or architecture documents rather than controlled comparative studies

Context

Mario Zechner's public talk transcript and Pi documentation argue that coding agents should adapt to the user's workflow by letting the agent write and load extensions, providers, and compaction logic inside the same session. [fact; source: https://github.com/The-Focus-AI/youtube-feed/blob/main/ai-engineer/videos/RjfbvDXpFls.json; https://mariozechner.at/posts/2025-11-30-pi-coding-agent/; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md]

Adjacent completed repository items on context transparency, extension systems, benchmark design, access control, and sustainable governance suggest that this architectural claim should be judged less by novelty than by what it does to observability, permission scope, reproducibility, and debugging discipline. [inference; source: https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-coding-agent-context-management-transparency.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-extension-systems-ai-coding-agents.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-terminal-bench-minimal-coding-agent-benchmarks.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-04-26-access-control-amplification-agentic-operations.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-sustainable-ai-software-development-synthesis.md]

Approach

  1. Taxonomy of self-modification: classify types of runtime self-modification in deployed coding agents, and distinguish hot reload of extensions from changes to core decision logic.
  2. Benefits evidence: assess what practitioner and product evidence supports the adaptability claim, and whether any retrieved evidence shows materially better outcomes for users.
  3. Risks evidence: review documented failure modes in security, reproducibility, and debuggability.
  4. Formal safety considerations: examine corrigibility literature to test whether self-modifying agents can safely preserve their own correction mechanisms.
  5. Practical comparison: compare what Pi, aider, Claude Code, and OpenCode allow in concrete workflow scenarios, and identify where self-modification changes the capability envelope.

Sources

Related


Research Skill Output

(Full output from running the research skill, retained verbatim in the completed item. Sections 0-5 are the investigation, and section 6 seeds the Findings section below.)

§0 Initialise

§1 Question Decomposition

  • A. What kinds of runtime mutation are actually present in retrieved coding harnesses?
    • A1. Which systems expose only user-steered commands and configuration?
    • A2. Which systems expose plugins, hooks, or custom tools?
    • A3. Which systems allow the agent to author and reload new behaviour inside the active session?
  • B. What evidence supports the capability case for self-modification?
    • B1. What benefits are explicitly claimed in creator and platform documents?
    • B2. What workflows become easier when the harness can change itself?
    • B3. Is there controlled evidence that self-modification improves outcomes?
  • C. What evidence supports the risk case?
    • C1. What do the retrieved sources say about reload safety, state reconstruction, and stale references?
    • C2. What do mature extension platforms use to contain blast radius?
    • C3. What governance and debugging problems follow when runtime surfaces can change mid-session?
  • D. What does formal safety work imply?
    • D1. What does corrigibility literature say about systems that can be modified or shut down?
    • D2. How much of that applies directly to coding-harness self-modification?
    • D3. What follows for practical control design?
  • E. How should self-modifying and fixed architectures be compared in practice?
    • E1. What does Pi enable that bounded harnesses do not readily enable?
    • E2. What do bounded harnesses preserve better?
    • E3. Which deployment context favors which side of the tradeoff?

§2 Investigation

Access and substitution notes

  • [assumption] The seeded Pi repository URL https://github.com/nichochar/pi-agent no longer resolves, so the current creator-controlled repository and linked manuals at https://github.com/badlogic/pi-mono were used instead. Justification: those materials expose the relevant extension, provider, and compaction surfaces directly.

A. Taxonomy of runtime self-modification

B. Benefits evidence

C. Risks evidence

D. Formal safety considerations

E. Practical comparison

§3 Reasoning

§4 Consistency Check

§5 Depth and Breadth Expansion

§6 Synthesis

Executive summary:

Key findings:

  1. [inference] The retrieved coding-agent harnesses sit on a spectrum from bounded, user-steered interfaces such as aider to plugin-configured systems such as Claude Code and OpenCode, with Pi at the far end of live in-session mutation rather than a clean binary split between self-modifying and fixed systems. Confidence: medium. Source: https://aider.chat/docs/usage/commands.html; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md
  2. [fact] Pi's self-modifying architecture is operationally real, because its public documentation shows that the agent can write and hot-reload TypeScript extensions that register tools, commands, providers, state, and compaction behavior inside the active runtime. Confidence: medium. Source: https://github.com/The-Focus-AI/youtube-feed/blob/main/ai-engineer/videos/RjfbvDXpFls.json; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md
  3. [inference] The strongest supported benefit of self-modification is rapid local workflow adaptation without fork-and-redeploy friction, especially for niche tools, custom provider paths, and task-specific compaction or summary policies that bounded harnesses usually expose only through pre-authored configuration or upstream product changes. Confidence: medium. Source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://opencode.ai/docs/plugins; https://docs.anthropic.com/en/docs/claude-code/plugins
  4. [inference] The strongest documented costs are reproducibility loss, harder debugging, and expanded security surface, because live reload and mutable extension code create stale-state and blast-radius problems that mature plugin ecosystems explicitly mitigate with cleanup rules, permission declarations, runtime separation, and activation controls. Confidence: high. Source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host
  5. [inference] Formal Artificial Intelligence safety literature does not support trusting a self-modifying agent to preserve its own corrigibility, because default utility-maximizing systems resist correction and safe shutdown remains a non-trivial design problem even before broad self-modification is introduced. Confidence: medium. Source: https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf
  6. [inference] For practical coding agents, the retrieved evidence favors a small stable kernel plus explicit extension points, external permissions, and inspectable mutation boundaries as the most defensible current default for shared deployments, even though it does not prove that no safer bounded self-modification regime exists. Confidence: medium. Source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-04-26-access-control-amplification-agentic-operations.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-extension-systems-ai-coding-agents.md
  7. [inference] Public evidence does not show that live self-modification is necessary for strong coding performance, and adjacent benchmark work in this repository indicates that minimal, bounded harnesses can already perform strongly on realistic command-line coding tasks. Confidence: medium. Source: https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-terminal-bench-minimal-coding-agent-benchmarks.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-ai-coding-harness-quality-benchmarks.md
  8. [inference] A hybrid model, bounded in-session extension authoring under explicit permissions, visible mutation logs, and reviewable reload boundaries, is the strongest plausible route for preserving some self-modification benefits without accepting the full governance cost of an unconstrained runtime, but the retrieved evidence does not yet show how much of Pi's adaptation advantage survives that constraint. Confidence: medium. Source: https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html

Evidence map:

claim source confidence notes
[inference] Retrieved harnesses form a spectrum from bounded to live self-modifying rather than a strict binary. https://aider.chat/docs/usage/commands.html; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md medium architecture comparison
[fact] Pi documents live in-session extension authoring and reload across tools, providers, and compaction. https://github.com/The-Focus-AI/youtube-feed/blob/main/ai-engineer/videos/RjfbvDXpFls.json; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md high direct primary docs
[inference] Self-modification's clearest benefit is local workflow adaptation without fork-and-redeploy overhead. https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://opencode.ai/docs/plugins; https://docs.anthropic.com/en/docs/claude-code/plugins medium documentary evidence
[inference] Reproducibility, debugging, and security costs rise because reloadable mutation needs lifecycle cleanup and containment. https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host high convergent platform guidance
[inference] Corrigibility literature does not justify trusting a self-modifying agent to preserve safe correction by default. https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf medium formal safety qualifier
[inference] The current evidence favors a stable kernel plus external permissions and visible mutation boundaries as the most defensible shared-deployment default, without proving that no safer bounded self-modification regime exists. https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-04-26-access-control-amplification-agentic-operations.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-extension-systems-ai-coding-agents.md medium control-surface synthesis
[inference] Strong coding performance does not yet require live self-modification. https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-terminal-bench-minimal-coding-agent-benchmarks.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-ai-coding-harness-quality-benchmarks.md medium adjacent benchmark qualifier
[inference] A bounded in-session extension model is the strongest plausible compromise, but the retrieved evidence does not yet quantify how much benefit survives those constraints. https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html medium hybrid-path qualifier

Assumptions:

Analysis:

The practical distinction concerns the location of authorship and activation: every inspected system has some customization path, but only some of them let the agent author and activate new capability inside the running session itself. [inference; source: https://aider.chat/docs/usage/commands.html; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md]

Pi pushes that boundary furthest by collapsing extension authoring, activation, and use into one loop, which plausibly reduces adaptation latency for expert users but also makes runtime state hygiene and mutation observability part of everyday harness operation. [inference; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md]

The comparison platforms show what is lost when that boundary moves inward: Chrome, VS Code, JetBrains, Claude Code, and OpenCode all rely on explicit manifests, permissions, lifecycle hooks, or startup-loaded plugins to keep mutable power subordinate to a more stable host. [inference; source: https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html; https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/plugins]

Formal corrigibility work sharpens the safety reading: broad self-modification and safe self-constraint are difficult to align even in stylized settings, so coding-agent deployments should not assume that an agent which can modify its own runtime will also preserve the human's preferred control boundaries without external enforcement. [inference; source: https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf]

The strongest deployment conclusion is therefore conditional rather than absolutist: self-modification is a real and useful capability for expert experimentation, but the best-supported shared-environment default remains bounded extensibility with visible mutation boundaries and external permissions. [inference; source: https://www.anthropic.com/engineering/claude-code-best-practices; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-sustainable-ai-software-development-synthesis.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-04-26-access-control-amplification-agentic-operations.md]

A hybrid path, bounded in-session extension authoring under explicit permissions and reviewable reload boundaries, is the strongest plausible compromise between Pi-style adaptation and fixed-harness legibility, but the retrieved evidence does not yet show how much of the adaptation advantage survives those controls. [inference; source: https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html]

Risks, gaps, uncertainties:

Open questions:

  • What measurement design would isolate the effect of live self-modification from the effect of model quality, task selection, and ordinary plugin support?
  • Which mutation events must be surfaced to users in real time for a self-modifying harness to remain debuggable under team use?
  • Can a bounded permission model for in-session extension authoring preserve most of Pi's adaptation benefits without accepting a full trusted-admin runtime?

§7 Recursive Review

  • Metadata: label and source audit completed; synthesis and Findings aligned; acronym first uses expanded; confidence kept at medium because the outcome evidence is architectural and documentary rather than experimental.
  • Metadata: prior completed items on extension systems, context transparency, access control, sustainability, and benchmarks were re-checked before finalizing the synthesis.
  • Metadata: no claim was kept at high confidence unless it rested on direct platform documentation or convergent primary documentation from more than one source.

Findings

Executive Summary

Self-modifying coding-agent architectures trade bounded predictability for local adaptability, and the retrieved evidence supports them as powerful but governance-heavy expert surfaces rather than as a proven general default. [inference; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-sustainable-ai-software-development-synthesis.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-terminal-bench-minimal-coding-agent-benchmarks.md]

Within the retrieved public documentation, Pi exposes the broadest live mutation surface, while aider appears the most bounded and user-steered, and Claude Code plus OpenCode occupy a plugin and hook middle layer. [inference; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://aider.chat/docs/usage/commands.html; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins]

The clearest benefits of self-modification are rapid workflow adaptation and feature creation without forking or waiting for upstream releases, but the clearest costs are larger security surfaces, weaker reproducibility, and harder debugging. [inference; source: https://github.com/The-Focus-AI/youtube-feed/blob/main/ai-engineer/videos/RjfbvDXpFls.json; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en]

Formal corrigibility literature does not justify trusting a self-modifying runtime to preserve its own correction path, so practical safety should stay anchored in external permissions, review, and deployment controls. [inference; source: https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf; https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config]

A hybrid middle path, bounded in-session extension authoring under explicit permissions, visible mutation logs, and reviewable reload boundaries, is the most plausible route for preserving some self-modification benefits without accepting a fully trusted-admin runtime, but the retrieved evidence does not yet show how much of the benefit survives those constraints. [inference; source: https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html]

Key Findings

  1. The retrieved coding-agent harnesses sit on a spectrum from bounded, user-steered interfaces such as aider to plugin-configured systems such as Claude Code and OpenCode, with Pi at the far end of live in-session mutation rather than a clean binary split between self-modifying and fixed systems. ([inference]; medium confidence; source: https://aider.chat/docs/usage/commands.html; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md)
  2. Pi's self-modifying architecture is operationally real, because its public documentation shows that the agent can write and hot-reload TypeScript extensions that register tools, commands, providers, state, and compaction behavior inside the active runtime. ([fact]; medium confidence; source: https://github.com/The-Focus-AI/youtube-feed/blob/main/ai-engineer/videos/RjfbvDXpFls.json; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md)
  3. The strongest supported benefit of self-modification is rapid local workflow adaptation without fork-and-redeploy friction, especially for niche tools, custom provider paths, and task-specific compaction or summary policies that bounded harnesses usually expose only through pre-authored configuration or upstream product changes. ([inference]; medium confidence; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://opencode.ai/docs/plugins; https://docs.anthropic.com/en/docs/claude-code/plugins)
  4. The strongest documented costs are reproducibility loss, harder debugging, and expanded security surface, because live reload and mutable extension code create stale-state and blast-radius problems that mature plugin ecosystems explicitly mitigate with cleanup rules, permission declarations, runtime separation, and activation controls. ([inference]; high confidence; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host)
  5. Formal Artificial Intelligence safety literature does not support trusting a self-modifying agent to preserve its own corrigibility, because default utility-maximizing systems resist correction and safe shutdown remains a non-trivial design problem even before broad self-modification is introduced. ([inference]; medium confidence; source: https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf)
  6. For practical coding agents, the retrieved evidence favors a small stable kernel plus explicit extension points, external permissions, and inspectable mutation boundaries as the most defensible current default for shared deployments, even though it does not prove that no safer bounded self-modification regime exists. ([inference]; medium confidence; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-04-26-access-control-amplification-agentic-operations.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-extension-systems-ai-coding-agents.md)
  7. Public evidence does not show that live self-modification is necessary for strong coding performance, and adjacent benchmark work in this repository indicates that minimal, bounded harnesses can already perform strongly on realistic command-line coding tasks. ([inference]; medium confidence; source: https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-terminal-bench-minimal-coding-agent-benchmarks.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-ai-coding-harness-quality-benchmarks.md)
  8. A hybrid model, bounded in-session extension authoring under explicit permissions, visible mutation logs, and reviewable reload boundaries, is the strongest plausible route for preserving some self-modification benefits without accepting the full governance cost of an unconstrained runtime, but the retrieved evidence does not yet show how much of Pi's adaptation advantage survives that constraint. ([inference]; medium confidence; source: https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html)

Evidence Map

Claim Source Confidence Notes
[inference] Retrieved harnesses form a spectrum from bounded to live self-modifying rather than a strict binary. https://aider.chat/docs/usage/commands.html; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md medium architecture comparison
[fact] Pi documents live in-session extension authoring and reload across tools, providers, and compaction. https://github.com/The-Focus-AI/youtube-feed/blob/main/ai-engineer/videos/RjfbvDXpFls.json; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md medium direct primary docs
[inference] Self-modification's clearest benefit is local workflow adaptation without fork-and-redeploy overhead. https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/custom-provider.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md; https://opencode.ai/docs/plugins; https://docs.anthropic.com/en/docs/claude-code/plugins medium documentary evidence
[inference] Reproducibility, debugging, and security costs rise because reloadable mutation needs lifecycle cleanup and containment. https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host high convergent platform guidance
[inference] Corrigibility literature does not justify trusting a self-modifying agent to preserve safe correction by default. https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf medium formal safety qualifier
[inference] The current evidence favors a stable kernel plus external permissions and visible mutation boundaries as the most defensible shared-deployment default, without proving that no safer bounded self-modification regime exists. https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-04-26-access-control-amplification-agentic-operations.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-extension-systems-ai-coding-agents.md medium control-surface synthesis
[inference] Strong coding performance does not yet require live self-modification. https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-terminal-bench-minimal-coding-agent-benchmarks.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-ai-coding-harness-quality-benchmarks.md medium adjacent benchmark qualifier
[inference] A bounded in-session extension model is the strongest plausible compromise, but the retrieved evidence does not yet quantify how much benefit survives those constraints. https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/config; https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html medium hybrid-path qualifier

Assumptions

  • The retrieved public manuals describe the dominant control surfaces accurately enough to compare architecture classes, even though unpublished internal implementation details or incidents may exist. [assumption; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins]
  • The absence of a documented live in-session extension API in the retrieved aider pages is enough to classify aider as the most bounded harness in this comparison, even though other pages not retrieved could expose additional customization features. [assumption; source: https://aider.chat/docs/usage.html; https://aider.chat/docs/usage/commands.html; https://aider.chat/docs/usage/caching.html]

Analysis

The practical distinction concerns the location of authorship and activation: every inspected system has some customization path, but only some of them let the agent author and activate new capability inside the running session itself. [inference; source: https://aider.chat/docs/usage/commands.html; https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md]

Pi pushes that boundary furthest by collapsing extension authoring, activation, and use into one loop, which plausibly reduces adaptation latency for expert users but also makes runtime state hygiene and mutation observability part of everyday harness operation. [inference; source: https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/extensions.md; https://github.com/badlogic/pi-mono/blob/main/packages/coding-agent/docs/compaction.md]

The comparison platforms show what is lost when that boundary moves inward: Chrome, VS Code, JetBrains, Claude Code, and OpenCode all rely on explicit manifests, permissions, lifecycle hooks, or startup-loaded plugins to keep mutable power subordinate to a more stable host. [inference; source: https://developer.chrome.com/docs/extensions/develop/concepts/declare-permissions?hl=en; https://code.visualstudio.com/api/advanced-topics/extension-host; https://plugins.jetbrains.com/docs/intellij/dynamic-plugins.html; https://docs.anthropic.com/en/docs/claude-code/hooks; https://opencode.ai/docs/plugins]

Formal corrigibility work sharpens the safety reading: broad self-modification and safe self-constraint are difficult to align even in stylized settings, so coding-agent deployments should not assume that an agent which can modify its own runtime will also preserve the human's preferred control boundaries without external enforcement. [inference; source: https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf]

The strongest deployment conclusion is therefore conditional rather than absolutist: self-modification is a real and useful capability for expert experimentation, but bounded extensibility remains the stronger default for shared environments where debugging, auditability, and least-privilege governance matter more than local feature velocity. [inference; source: https://www.anthropic.com/engineering/claude-code-best-practices; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-sustainable-ai-software-development-synthesis.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-04-26-access-control-amplification-agentic-operations.md]

Risks, Gaps, and Uncertainties

  • The evidence base for benefits is thinner than the evidence base for control patterns, because the retrieved sources document architecture and workflow examples more often than they report controlled outcome measurements. [inference; source: https://mariozechner.at/posts/2025-11-30-pi-coding-agent/; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-ai-coding-harness-quality-benchmarks.md]
  • Formal corrigibility results concern broad agent objectives more directly than narrow runtime extension loading, so they qualify the safety story without fully determining the correct governance pattern for coding harnesses. [inference; source: https://intelligence.org/files/Corrigibility.pdf; https://cdn.aaai.org/ocs/ws/ws0354/15156-68335-1-PB.pdf]
  • OpenCode and Claude Code clearly document plugin and hook surfaces, but the retrieved docs do not quantify how often agents in practice author those surfaces autonomously versus humans pre-configuring them. [inference; source: https://docs.anthropic.com/en/docs/claude-code/plugins; https://opencode.ai/docs/plugins]
  • Adjacent benchmark evidence constrains claims about core capability, but it does not yet isolate the marginal performance effect of self-modification itself. [inference; source: https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-terminal-bench-minimal-coding-agent-benchmarks.md; https://github.com/davidamitchell/Research/blob/main/Research/completed/2026-05-01-ai-coding-harness-quality-benchmarks.md]

Open Questions

  • What experimental design would isolate the effect of live self-modification from the effects of model quality, task selection, and ordinary plugin support?
  • Which mutation events must be surfaced to users in real time for a self-modifying harness to remain debuggable under team use?
  • Can a bounded permission model for in-session extension authoring preserve most of Pi's adaptation benefits without accepting a full trusted-admin runtime?

Output

Navigation

Home

By Tag

bureaucracy

change-management

coase

constraint-analysis

control-model

decision-rights

delegation

delivery-risk

demand-segmentation

enterprise

exception-handling

execution

flow

flow-design

flow-metrics

governance

governance-patterns

incentives

instability

institutional-economics

leading-indicators

operating-model

organisation

organisational-design

queue-design

queueing

regulated-enterprise

routing

throughput

throughput-risk

transaction-costs

triage

williamson

Clone this wiki locally