Skip to content

refactor(skills): derive implementation guidance from source - #8159

Merged
cv merged 10 commits into
mainfrom
codex/reduce-contributor-skill-drift
Aug 4, 2026
Merged

refactor(skills): derive implementation guidance from source#8159
cv merged 10 commits into
mainfrom
codex/reduce-contributor-skill-drift

Conversation

@jyaunches

@jyaunches jyaunches commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Summary

Refactor the checked-in contributor implementation skills so they describe durable process and priorities while deriving implementation details from the current checkout. This reduces the chance that skill guidance silently drifts from the code it is meant to help change.

Changes

  • Add a shared source-first discovery procedure for implementation work, including early trust-boundary identification and security-review routing.
  • Reduce the dependency, Hermes, messaging-channel, and documentation implementation skills to workflow guidance, decision priorities, and evidence expectations.
  • Remove duplicated code-derived inventories, including the Hermes contract map, and simplify the remaining dependency references.
  • Update skill contract tests to enforce concise, discovery-based guidance instead of exact prose snapshots.

Type of Change

  • Code change (feature, bug fix, or refactor)
  • Code change with doc updates
  • Doc only (prose changes, no code sample modifications)
  • Doc only (includes code sample changes)

Quality Gates

  • Tests added or updated for changed behavior
  • Existing tests cover changed behavior — justification:
  • Tests not applicable — justification:
  • Docs updated for user-facing behavior changes
  • Docs not applicable — justification: This changes repository contributor-agent guidance, not a user-facing NemoClaw product surface.
  • Sensitive paths changed (security, policy, credentials, preflight, onboarding, inference, runner, sandbox, or messaging)
  • Sensitive-path review completed or maintainer-approved waiver recorded — reviewer/approval link/justification:
  • Non-success, skipped, or missing CI check accepted by maintainer — check name, approval link, and follow-up issue:

Documentation Writer Review

  • Documentation writer subagent reviewed the completed changes
  • Result: docs-updated
  • Evidence: Reviewed the full PR diff and final implementation-guidance simplification against current AGENTS.md, WRITING.md, the controlled word list, and the documentation-writing-review contract. Clean-context forward testing found no missing durable guidance; focused tests passed 63/63; repository checks, Biome, git diff check, pre-commit, and commit-msg passed.
  • Agent: Codex Desktop

DGX Station Hardware Evidence

  • Tested on DGX Station
  • Tested commit:
  • Station profile/scenario:
  • Result:
  • Supporting evidence:

Verification

  • PR description includes a Signed-off-by: line and every commit appears as Verified in GitHub
  • Normal pre-commit, commit-msg, and pre-push hooks passed, or npm run validate:pr passed after refreshing origin/main when hooks were skipped or unavailable
  • Targeted behavior tests pass for the current change set, or tests are marked not applicable above — command/result or justification: The four original focused integration files passed 83/83 tests. test/dependency-upgrade-skill-security.test.ts passed 18/18 after the CI correction; test/skills-frontmatter.test.ts passed 30/30 after the messaging correction; the durable-gate follow-up passed 35/35 focused tests; the authority-link follow-up passed 49/49 focused tests; the final implementation-guidance simplification passed 63/63 focused tests and a clean-context forward test.
  • Applicable broad gate passed — npm test for broad runtime/test-harness changes; npm run check for repo-wide validation/coverage changes — command/result: Not applicable; this refactor does not change the runtime or test harness. npm run checks:repository passed.
  • Quality Gates section completed with required justifications or waivers
  • No secrets, API keys, or credentials committed
  • npm run docs builds without warnings (doc changes only)
  • Doc pages follow the style guide (doc changes only)
  • New doc pages include SPDX header and frontmatter (new pages only)

Signed-off-by: Julie Yaunches jyaunches@nvidia.com

Summary by CodeRabbit

  • Documentation

    • Updated contributor guidance for documentation, dependency upgrades, Hermes updates, and messaging-channel changes.
    • Added implementation-discovery guidance focused on current repository behavior, trusted tooling, and security boundaries.
    • Simplified migration, release-audit, and documentation workflows, including fallback validation guidance.
    • Removed obsolete Hermes reference material and refreshed the contributor skills catalog.
  • Tests

    • Updated validation for revised contributor guidance, streamlined workflows, discovery-based practices, and security-boundary requirements.

@jyaunches jyaunches added refactor PR restructures code without intended behavior change area: skills Skills, agent behaviors, prompts, or skill packaging labels Aug 3, 2026
@jyaunches jyaunches self-assigned this Aug 3, 2026
@coderabbitai

coderabbitai Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

The PR adds shared implementation-discovery guidance and rewrites contributor skills for messaging channels, dependency updates, Hermes updates, and documentation. It updates the skills catalog and tests to enforce current, discovery-based guidance.

Changes

Contributor guidance modernization

Layer / File(s) Summary
Shared discovery and validation guidance
.agents/skills/_shared/*
Adds repository-based implementation discovery, trust-boundary review, evidence requirements, and contributor-guidance fallback validation.
Messaging-channel workflow
.agents/skills/nemoclaw-contributor-onboard-messaging-channel/SKILL.md
Replaces manifest-first instructions with architecture discovery, explicit contracts, minimal declarative changes, security boundaries, and focused verification.
Dependency and Hermes migration workflows
.agents/skills/nemoclaw-contributor-update-dependencies/*, .agents/skills/nemoclaw-contributor-update-hermes/*
Condenses migration workflows around contract discovery, release audits, immutable artifacts, semantic migrations, verification, and evidence handoff.
Documentation workflow and catalog
.agents/skills/nemoclaw-contributor-update-docs/SKILL.md, .agents/skills/nemoclaw-skills-guide/SKILL.md
Reworks documentation updates around current behavior, ownership, release state, repository policy, and validation. Updates catalog descriptions.
Skill policy tests
test/*skill*.test.ts, test/maintainer-skills-policy.test.ts
Updates tests for concise skills, shared guidance references, current policy wording, catalog registration, and removed legacy content.

Estimated code review effort: 3 (Moderate) | ~25 minutes

Possibly related PRs

Suggested reviewers: apurvvkumaria

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly summarizes the primary refactor toward deriving implementation guidance from the current source.
✨ Finishing Touches 💡 1
🛠️ Fix failing CI checks 💡
  • Create stacked PR
  • Commit on current branch
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/reduce-contributor-skill-drift

Comment @coderabbitai help to get the list of available commands.

@github-code-quality

github-code-quality Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Code Coverage Overview

Languages: TypeScript

TypeScript / code-coverage/plugin

The overall coverage in commit 4da0be8 in the codex/reduce-contrib... branch remains at 96%, unchanged from commit ed880a5 in the main branch.

TypeScript / code-coverage/cli

The overall coverage in commit 4da0be8 in the codex/reduce-contrib... branch remains at 81%, unchanged from commit 643a4ab in the main branch.

Show a code coverage summary of the most impacted files.
File main 643a4ab codex/reduce-contrib... 4da0be8 +/-
src/lib/actions...oy-execution.ts 95% 89% -6%
src/lib/shields/index.ts 70% 69% -1%
src/lib/shields...nsition-lock.ts 88% 87% -1%
src/lib/policy/index.ts 59% 59% 0%
src/lib/actions...dbox/destroy.ts 89% 89% 0%
src/lib/actions...eway-restart.ts 92% 92% 0%
src/lib/actions...licy-channel.ts 80% 81% +1%
src/lib/actions...ess-recovery.ts 82% 84% +2%
src/lib/domain/.../connect-env.ts 89% 97% +8%
src/lib/onboard...ization-deps.ts 58% 83% +25%

Updated August 04, 2026 07:16 UTC

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.agents/skills/nemoclaw-contributor-onboard-messaging-channel/SKILL.md:
- Around line 16-18: Update the accepted scope decision guidance near “Confirm
that an accepted issue or design decision” to explicitly require runtime and
version compatibility expectations alongside supported channel, agent runtimes,
ownership, lifecycle, security, and validation boundaries before implementation.
Preserve the existing Community Solutions routing guidance for integrations
without established product scope.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 5e0e72eb-bdbd-4aec-bdb8-ae69bf1e2de8

📥 Commits

Reviewing files that changed from the base of the PR and between f12ae8d and 8f1db04.

📒 Files selected for processing (14)
  • .agents/skills/_shared/documentation-writing-review.md
  • .agents/skills/_shared/implementation-discovery.md
  • .agents/skills/nemoclaw-contributor-onboard-messaging-channel/SKILL.md
  • .agents/skills/nemoclaw-contributor-update-dependencies/SKILL.md
  • .agents/skills/nemoclaw-contributor-update-dependencies/references/contract-audit.md
  • .agents/skills/nemoclaw-contributor-update-dependencies/references/release-ledger.md
  • .agents/skills/nemoclaw-contributor-update-docs/SKILL.md
  • .agents/skills/nemoclaw-contributor-update-hermes/SKILL.md
  • .agents/skills/nemoclaw-contributor-update-hermes/references/hermes-contract-map.md
  • .agents/skills/nemoclaw-skills-guide/SKILL.md
  • test/dependency-upgrade-skill.test.ts
  • test/hermes-upgrade-skill.test.ts
  • test/maintainer-skills-policy.test.ts
  • test/skills-frontmatter.test.ts
💤 Files with no reviewable changes (1)
  • .agents/skills/nemoclaw-contributor-update-hermes/references/hermes-contract-map.md

Comment thread .agents/skills/nemoclaw-contributor-onboard-messaging-channel/SKILL.md Outdated
@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

PR Review Advisor — Informational

Advisor assessment: Informational / low confidence
Next action: No advisor follow-up needed.
Findings: 0 blockers · 0 warnings · 0 suggestions
Status: Partial review preserved 0 canonical finding(s) and 3 terminology decision(s) before the advisor stopped.

Model lanes

  • GPT-5.6 Terra (primary): Failed after a partial review · low confidence · 0 blockers · 0 warnings · 0 suggestions
  • Nemotron 3 Ultra (second opinion): Failed

Second-opinion terminology and E2E selections are advisory. They do not change the primary assessment or E2E / PR Gate.

3 semantic terminology decisions

Terminology decisions are advisory. They affect the assessment only when a separate finding identifies concrete semantic impact.

  • established — product scope gate at .agents/skills/_shared/implementation-discovery.md:13: Keep the established term.
  • established — Community Solutions at .agents/skills/nemoclaw-contributor-onboard-messaging-channel/SKILL.md:18: Keep the established product name.
  • justified — current implementation at .agents/skills/_shared/implementation-discovery.md:4: Keep the modifier because it identifies the authoritative evidence source.

E2E guidance

Advisory only. E2E / PR Gate selects and runs jobs independently.

Recommended E2E: None

Workflow run details

This automated review informs maintainers. Warnings and suggestions do not require a response. A maintainer decides whether to merge.

@apurvvkumaria apurvvkumaria left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — reviewed exact head 4314199. The source-first skill refactor keeps repository-owned source and tests authoritative, preserves contributor security and provenance gates, and updates the contract tests consistently. The final delta only strengthens durable gate assertions. I found no blocking correctness, security, compatibility, test, or regression defect. The macOS failure is unrelated to this skills-only diff: the runtime test observed an unverified runner process PID.

@apurvvkumaria apurvvkumaria left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Re-reviewed the current head (4662389), including the follow-up commit that replaces ambiguous guidance with repository-owned policy links and adds focused assertions. I found no blocking correctness, security, compatibility, or regression issue in the updated diff.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.agents/skills/_shared/implementation-discovery.md:
- Around line 17-18: Update the behavior-verification guidance in
implementation-discovery.md to limit current source and tests to runtime
behavior. Treat current AGENTS.md and repository policy documents as
authoritative for contributor-process and documentation claims, while retaining
history, issues, PRs, and other documentation as rationale sources.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 0264c9f4-5ebb-47ba-bd57-d2bf4cf3f2dc

📥 Commits

Reviewing files that changed from the base of the PR and between 4662389 and bc14e7f.

📒 Files selected for processing (3)
  • .agents/skills/_shared/implementation-discovery.md
  • test/dependency-upgrade-skill.test.ts
  • test/skills-frontmatter.test.ts
🚧 Files skipped from review as they are similar to previous changes (2)
  • test/dependency-upgrade-skill.test.ts
  • test/skills-frontmatter.test.ts

Comment thread .agents/skills/_shared/implementation-discovery.md

@apurvvkumaria apurvvkumaria left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Re-reviewed current head bc14e7f after the new implementation-discovery rewrite. The added commit removes duplicated generic mechanics while retaining the repository-source-of-truth rule, active AGENTS guidance, product-scope and trust-boundary gates, current-source verification, and task-specific evidence requirements. The paired tests correctly enforce that smaller contract. I found no blocking correctness, security, compatibility, or regression issue. The two image-build failures are from newly surfaced npm audit findings in the unchanged MCP tool-discovery dependency tree on both architectures, not from this skill-only delta; remaining exact-head checks are still running.

@copy-pr-bot

copy-pr-bot Bot commented Aug 3, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@apurvvkumaria apurvvkumaria left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Re-reviewed exact head e2e113f after the main merge. Every effective PR blob remains identical to the previously approved revision. The two newer Hermes base edits are intentionally superseded by the source-first workflow: the current skill requires contributors to derive wrapper, adapter, compatibility, security, and validation surfaces from current source rather than a stale maintained map. Focused Hermes and policy contract validation passes 52 of 52 tests. The broader local failures are confined to an unchanged release-ledger helper running under the host Python 3.9, not this PR delta. No blocking defect found.

prekshivyas and others added 4 commits August 3, 2026 23:43
<!-- markdownlint-disable MD041 -->
## Summary

Remove the dedicated Hermes implementation skill and route Hermes
release work through the general dependency-upgrade workflow. Keep only
the Hermes-specific CalVer collection and base-image publication gates
in a conditional reference so implementation details continue to come
from source and tests.

This PR is stacked on #8159 and should be reviewed and merged after it.
Once #8159 merges, this PR can target `main` without carrying duplicate
skill-refactor changes.

## Changes

- Remove the dedicated Hermes skill, agent metadata, catalog entry, and
obsolete skill test while preserving narrow update, review, and
publication triggers in the dependency skill.
- Move the Hermes CalVer helper beneath the dependency skill and use its
ordered release endpoints as adjacent audit boundaries only when the
generic collector does not cover the selected range.
- Keep concise, process-level Hermes base-image publication guidance
without maintaining code-derived path or contract inventories.
- Bring the moved helper under the parent collector's private-output
contract with descriptor-anchored mode-`0600` writes, no replacement or
symlink following, unsafe-directory rejection, and failure cleanup.

## Type of Change

- [x] Code change (feature, bug fix, or refactor)
- [ ] Code change with doc updates
- [ ] Doc only (prose changes, no code sample modifications)
- [ ] Doc only (includes code sample changes)

## Quality Gates

- [x] Tests added or updated for changed behavior
- [ ] Existing tests cover changed behavior — justification:
- [ ] Tests not applicable — justification:
- [ ] Docs updated for user-facing behavior changes
- [x] Docs not applicable — justification: No user-facing product
behavior changes. Contributor-agent routing is documented by the updated
checked-in skills catalog, and the exact-head documentation review
passed.
- [x] Sensitive paths changed (security, policy, credentials, preflight,
onboarding, inference, runner, sandbox, or messaging)
- [x] Sensitive-path review completed or maintainer-approved waiver
recorded — reviewer/approval link/justification: Codex Desktop
independently reviewed exact head `89e75241b` with the repository's
nine-category security checklist. All categories passed with no
remaining findings; evidence covers descriptor anchoring, ownership and
mode checks, files and symlinks, hostile directories, permissive umask,
and injected fsync failure cleanup.
- [ ] Non-success, skipped, or missing CI check accepted by maintainer —
check name, approval link, and follow-up issue:

## Documentation Writer Review

- [x] Documentation writer subagent reviewed the completed changes
- Result: `docs-updated`
- Evidence: Reviewed the full PR diff and final descriptor-anchored
output-security follow-up against current writing and documentation
rules. Affected tests passed 103/103; final focused tests passed 10/10;
repository checks, Biome, git diff checks, forward testing, pre-commit,
commit-msg, skill YAML, markdownlint, and gitleaks passed. Independent
nine-category security review passed. No user-facing `docs/` change is
needed because this changes contributor-agent routing, documented in the
skills catalog.
- Agent: Codex Desktop
<!-- docs-review-head-sha: 89e7524 -->
<!-- docs-review-agents-blob-sha: 3dd7c24 -->

## DGX Station Hardware Evidence

- [ ] Tested on DGX Station
- Tested commit:
- Station profile/scenario:
- Result:
- Supporting evidence:

## Verification

- [x] PR description includes a `Signed-off-by:` line and every commit
appears as `Verified` in GitHub
- [x] Normal `pre-commit`, `commit-msg`, and `pre-push` hooks passed, or
`npm run validate:pr` passed after refreshing `origin/main` when hooks
were skipped or unavailable
- [x] Targeted behavior tests pass for the current change set, or tests
are marked not applicable above — command/result or justification:
Affected integration selection passed 103/103; final variant and helper
tests passed 10/10.
- [ ] Applicable broad gate passed — `npm test` for broad
runtime/test-harness changes; `npm run check` for repo-wide
validation/coverage changes — command/result: Not applicable to this
narrow agent-skill and standalone-helper refactor; `npm run
checks:repository` passed.
- [x] Quality Gates section completed with required justifications or
waivers
- [x] No secrets, API keys, or credentials committed
- [ ] `npm run docs` builds without warnings (doc changes only)
- [ ] Doc pages follow the [style
guide](https://github.com/NVIDIA/NemoClaw/blob/main/docs/CONTRIBUTING.md)
(doc changes only)
- [ ] New doc pages include SPDX header and frontmatter (new pages only)

---
Signed-off-by: Julie Yaunches <jyaunches@nvidia.com>

---------

Co-authored-by: Prekshi Vyas <34834085+prekshivyas@users.noreply.github.com>
@cv
cv merged commit d58f67d into main Aug 4, 2026
16 of 21 checks passed
@cv
cv deleted the codex/reduce-contributor-skill-drift branch August 4, 2026 07:18
if created and not complete:
try:
os.unlink(output.name, dir_fd=directory)
except FileNotFoundError:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area: skills Skills, agent behaviors, prompts, or skill packaging refactor PR restructures code without intended behavior change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants