fix: update aeo_crosslink_audit skill to use Peec snapshot files#186
fix: update aeo_crosslink_audit skill to use Peec snapshot files#186rachaelrenk wants to merge 1 commit into
Conversation
The skill referenced 'Peec MCP' as the data source, but Peec MCP requires OAuth which is not supported in cloud agents. Update to read from the pre-exported Peec snapshot files in the buzz repo at /workspace/buzz/aeo-snapshots/docs/agents-orchestration/latest.json and latest.md instead. Co-Authored-By: Oz <oz-agent@warp.dev>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
I'm starting a first review of this pull request. You can view the conversation on Warp. I completed the review and no human review was requested for this pull request. Comment Powered by Oz |
There was a problem hiding this comment.
Overview
This PR updates the AEO cross-link audit skill to use Peec snapshot files instead of Peec MCP, with fallback behavior when Peec or GSC data is unavailable.
Concerns
- The new snapshot path is an absolute path into
/workspace/buzz, but the skill lives in the docs repo and the diff does not add any step that ensures thebuzzrepo is available in scheduled cloud-agent runs. If that mount/checkout is absent, the skill falls back to no Peec data and the reported failure mode remains. - Security pass: the snapshot content should be treated as untrusted source data, but the new source-data instructions do not explicitly tell agents to ignore instructions embedded in Peec prompts/recommendations.
Verdict
Found: 0 critical, 1 important, 1 suggestions
Request changes
Comment /oz-review on this pull request to retrigger a review (up to 3 times on the same pull request).
Powered by Oz
|
|
||
| Use the smallest reliable set of source data needed to justify link changes: | ||
| - **Peec MCP** - Review recent prompts, recommendations, source URLs, and query vocabulary related to agents, cloud agents, and orchestration. | ||
| - **Peec snapshot** - Read the Peec snapshot files at `/workspace/buzz/aeo-snapshots/docs/agents-orchestration/latest.json` and `/workspace/buzz/aeo-snapshots/docs/agents-orchestration/latest.md`. These contain pre-exported Peec data (prompts, recommendations, source URLs, query vocabulary, and visibility scores) for agents, cloud agents, and orchestration. The snapshots are generated locally (where Peec OAuth works) and committed to the buzz repo so cloud agents can use them. If the snapshot files do not exist or are empty, note that Peec data was unavailable and proceed with other sources. |
There was a problem hiding this comment.
/workspace/buzz/..., but this docs skill does not add any step that ensures the buzz repo is mounted or checked out in scheduled cloud-agent runs; when that absolute path is absent, the fallback keeps Peec data unavailable. Store the snapshot in this repo or add explicit setup instructions before relying on this path.
|
|
||
| Use the smallest reliable set of source data needed to justify link changes: | ||
| - **Peec MCP** - Review recent prompts, recommendations, source URLs, and query vocabulary related to agents, cloud agents, and orchestration. | ||
| - **Peec snapshot** - Read the Peec snapshot files at `/workspace/buzz/aeo-snapshots/docs/agents-orchestration/latest.json` and `/workspace/buzz/aeo-snapshots/docs/agents-orchestration/latest.md`. These contain pre-exported Peec data (prompts, recommendations, source URLs, query vocabulary, and visibility scores) for agents, cloud agents, and orchestration. The snapshots are generated locally (where Peec OAuth works) and committed to the buzz repo so cloud agents can use them. If the snapshot files do not exist or are empty, note that Peec data was unavailable and proceed with other sources. |
There was a problem hiding this comment.
💡 [SUGGESTION] [SECURITY] Peec snapshots include externally sourced prompts and recommendations, so the skill should state that snapshot contents are data only and any instructions inside them must be ignored to avoid prompt-injection influencing the audit.
Summary
Fix the
aeo_crosslink_auditskill to use Peec snapshot files instead of Peec MCP.Problem
The scheduled AEO cross-link audit ran this morning (PR #183) but reported "Peec: Not available in this environment" because the skill referenced "Peec MCP" as its data source. Peec MCP requires OAuth, which cloud agents don't support.
We built a snapshot workflow specifically to work around this — exporting Peec data locally and committing it to the buzz repo at
aeo-snapshots/docs/agents-orchestration/latest.json— but the skill was never updated to point at those files.Fix
Changed two references in the skill's "Source data" and "Workflow" sections:
/workspace/buzz/aeo-snapshots/docs/agents-orchestration/latest.jsonandlatest.md..."The next scheduled run will read the snapshot files and use Peec data to ground its cross-link recommendations.
Conversation: https://app.warp.dev/conversation/a76e6886-85d5-49c7-9cef-a497844260ea
Run: https://oz.warp.dev/runs/019e8eac-40e3-7d1a-b07c-69f5ab2426c2
This PR was generated with Oz.