I builty an AI observability tool with Codev!

[mohidmakhdoomi]

I Built a Filesystem Observer for AI Agent Sessions with Codev!

I just shipped ai-observe v0.1.0 — a Linux-first tool that wraps any command (especially an AI coding agent) and reports the net files it created, modified, or deleted under your watched roots, with a local browser viewer.

• Repo: https://github.com/mohidmakhdoomi/ai-observe
• Release: v0.1.0

What I Built

ai-observe --session demo -- bash -c 'echo hi > note.txt'
ai-observe-viewer .codev/observe/demo.jsonl

Wrap anything — bash, or your actual agent (claude, codex, gemini) — then open the viewer. It answers: "what did this thing actually touch on my disk?" It layers two sources of evidence — live strace (direct) and start/end snapshots (a backstop) — into one event stream where every event carries source + confidence, so directly observed changes stay distinct from inferred ones.

The Interesting Bits

• 🧅 Honest provenance — layer the evidence, label the uncertainty; no single Linux backend sees every mutation.
• 🔌 A real backend seam — strace/snapshot sit behind a small protocol, with room for fanotify/eBPF later.
• 🔒 Privacy-conscious viewer — binds only to 127.0.0.1 and strips raw syscalls/argv/PIDs before rendering; the named shims are deliberately not installed. (On-disk artifacts are unredacted — treat them as sensitive.)

Built with Codev

Orchestrated through Agent Farm (afx) + porch — autonomous builders in isolated worktrees, gated specs/plans, and 3-way review on the risky PRs.

• ~3,700 lines of production Python, zero runtime deps
• 322 tests · 13 specs → ~12,100 lines of specs/plans/reviews · 22 merged PRs

The part I'm proudest of: two rounds of live-agent EXPERIMENTs (Claude Code, agy, codex) that diffed what the agent actually did against what ai-observe reported. They surfaced three real bugs the unit tests missed — a codex sandbox path-filtering miss, dropped unlinkat deletions, and a sidecar mislabeling a snapshot-only session as authoritative — each fixed in follow-up work after v0.1.0. "It compiled" is not "it works."

[waleedkadous]

This is awesome! Great work.

[mohidmakhdoomi]

Thank you! Codev has been a great facilitator/enabler in this and other projects.