We are about to launch MAGI 2.0 that will MAX out the Agentic Environment setup for SKILL, MEMORY, USER and SESSION MD files. #21
Replies: 11 comments 3 replies
-
|
This resonates deeply with what we're seeing at scale. We run ~40 internal agents across different teams, and the "instruction entropy" framing is spot-on. Right now we have:
The worst part? When something breaks, we spend hours diffing markdown files trying to figure out which instruction conflicted with which. A proper compilation step that catches conflicts before runtime would save us days per month. The deterministic vs. judgment separation is the thing I'm most excited about. We've been burned multiple times by treating routing logic (which model handles what) as "judgment" when it should be hard-coded policy. MAGI making that boundary explicit would be huge. |
Beta Was this translation helpful? Give feedback.
-
|
The multi-target compilation story is what makes this a real product vs. just another spec. I maintain agent configs for three different runtimes (Claude Code, Cursor, and a custom orchestrator), and right now that means maintaining three separate instruction sets that are supposed to say the same thing but inevitably drift. Last month we found that our Cursor rules had a stale safety constraint that had been updated in CLAUDE.md weeks earlier. If MAGI can genuinely compile one source into AGENTS.md, CLAUDE.md, SKILL.md, Cursor rules, and Copilot instructions — that alone justifies the effort. But the key question is: how do you handle target-specific semantics? For example, CLAUDE.md supports hooks and MCP tool references that don't exist in Cursor. Does the compiler strip those, warn, or generate a target-specific fallback? Also: the phased rollout makes sense. Phase 1 (schema + target mappings) is the hardest design work. If the information model is right, the tooling follows. If it's wrong, you'll be fighting the schema forever. |
Beta Was this translation helpful? Give feedback.
-
|
From an evaluation perspective, the activation contracts and traceability pieces are the most underserved areas in the current ecosystem. We run weekly evals on our agent stack and the biggest gap is always: why did the agent do X instead of Y? The trace usually shows what the model output, but not which instructions were active, which skill triggered, or why a competing skill didn't fire. The PRD's concept of activation-rules as first-class objects is the right abstraction. If I can write: activation:
trigger: "user mentions database migration"
requires: [prisma-installed, postgres-connected]
conflicts-with: [raw-sql-skill]
priority: 2...and then get a trace that says "skill X activated because trigger matched, skill Y suppressed due to conflict resolution" — that changes how we debug agent behavior entirely. One concern: the PRD mentions "detecting unsupported dependencies before runtime." How deep does that go? Just checking if a tool exists, or actually validating that an MCP server exposes the expected methods? |
Beta Was this translation helpful? Give feedback.
-
|
The memory layer control section caught my eye. This is a real pain point that nobody is solving well right now. We use Claude Code's auto-memory and it's great for remembering user preferences, but it has no concept of:
If MAGI can define a memory schema that includes TTL, promotion rules, size caps, and conflict resolution — that's a massive improvement over "append to a markdown file and hope for the best." The PRD mentions "rules for what should never be promoted into long-term memory." Can you share what those rules look like in practice? Are they per-memory-entry annotations, or global policies? |
Beta Was this translation helpful? Give feedback.
-
|
The performance profiling angle is underrated in this discussion. Let me share a concrete example of why it matters. We have a skill that works great in isolation but when loaded alongside our main instruction file, it pushes the context to ~45k tokens before the user even says anything. That means:
Right now there's no way to know this until you're already in production. A MAGI profiler that can estimate:
...would let teams make informed decisions about which skills to load, which to lazy-load, and where to spend their context budget. This is the kind of tooling that turns agent development from art into engineering. |
Beta Was this translation helpful? Give feedback.
-
|
The eval integration piece deserves its own deep dive. Right now, evals and instructions live in completely separate worlds. You write a CLAUDE.md, you write some eval scripts, and you pray they stay in sync. What I'd love to see in MAGI: skill: database-migration
eval:
- input: "migrate users table to add email column"
expect:
- calls: [prisma-migrate, prisma-generate]
- does-not-call: [raw-sql-execute]
- output-contains: "migration complete"
grader: exact-tool-sequenceEvals as first-class citizens in the skill definition means:
The PRD mentions "attach evals to at least one compiled skill flow" as a success metric. I'd push further — every skill should require at least one eval to be considered "production-ready." Make it a linter rule. |
Beta Was this translation helpful? Give feedback.
-
|
One thing I want to highlight from the PRD that hasn't been discussed yet: the identity and cross-runtime story. The PRD mentions Hermes-specific files like Think about it: a customer support agent needs consistent personality traits, knowledge boundaries, and escalation rules across every runtime it's deployed on. Today you copy-paste that into each platform's config format. MAGI could compile one
The cross-runtime portability is what makes this a platform play rather than just a tooling improvement. If MAGI becomes the standard way to define agent identity, every new runtime that wants adoption would support MAGI compilation targets. That's a strong network effect. |
Beta Was this translation helpful? Give feedback.
-
|
The fallback contract idea is underappreciated. In our setup, we've had agents completely stall because a single MCP tool was unavailable and there was no graceful degradation path. MAGI fallback declarations could look like: fallbacks:
- when: playwright-mcp-unavailable
action: use-fetch-instead
degradation: "no browser automation, HTTP only"
- when: database-readonly
action: skip-write-operations
notify: userThis is essentially error handling for the instruction layer. Just like code has try/catch, agent instructions should have explicit fallback paths. And the compiler could validate that every critical dependency has a declared fallback — like a linter rule for resilience. |
Beta Was this translation helpful? Give feedback.
-
|
Agent-environment standards have been overdue. Curious how the migration from current |
Beta Was this translation helpful? Give feedback.
-
|
Looking forward to 2.0. The SKILL/MEMORY/USER/SESSION split feels like the right abstraction for agent-context lifecycle. |
Beta Was this translation helpful? Give feedback.
-
|
Agent-environment standards have been overdue. Curious how the migration from current |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Any good suggestions, please follow up here.
Beta Was this translation helpful? Give feedback.
All reactions