Skip to content

chore: untrack the per-run langsmith worker-attempt artifact - #2856

Merged
stranske merged 1 commit into
mainfrom
chore/untrack-langsmith-worker-attempt-artifact
Jul 31, 2026
Merged

chore: untrack the per-run langsmith worker-attempt artifact#2856
stranske merged 1 commit into
mainfrom
chore/untrack-langsmith-worker-attempt-artifact

Conversation

@stranske

Copy link
Copy Markdown
Owner

Why

langsmith-fleet-worker-attempt.json is written per run by reusable-codex-run.yml:1173 and uploaded as a build artifact (:1183). Nothing reads it from the repo. While tracked, every run that rewrote it produced a diff that codex-autofix then committed onto whatever PR happened to be open — two such commits landed on #2852 while it was in review (cd8daf6, cf81a94), which is how I found it.

It was also not on config/root-allowlist.txt, which health-40's "Root allowlist guard" enforces (it exits 1 on any tracked depth-0 file not on the list — issue #2277).

What changed

  • Remove langsmith-fleet-worker-attempt.json and add it to the existing .gitignore block for per-run CI snapshots, so autofix can't re-commit it.
  • While auditing the allowlist, four other tool-mandated root config files turned out to be unlisted too. Added: .coderabbit.yaml, .release-please-manifest.json, release-please-config.json, renovate.json. These must live at the repo root for CodeRabbit / release-please / Renovate to find them, so allowlisting (the guard's own documented remedy) is correct.

Verified with the guard's exact logic (git ls-files | awk -F/ 'NF==1' | grep -vxF -f config/root-allowlist.txt): before this PR 6 files were unlisted; after it, only testgen_gate.py remains.

Two things deliberately NOT changed

  1. testgen_gate.py — a 135-line one-off acceptance gate for [Route Weight][testgen] Add round-1 repo-review schema validator edge tests #2620, referenced by nothing but itself. That is exactly the "stray fixer script" class the guard was built to catch, so I did not allowlist it (that would silently bless it) and did not delete it (it is not mine to discard). It needs an explicit keep-or-delete decision. Until then the guard would still flag it.

  2. health-40's real failure. The Root allowlist guard has never reported any of the above because it is skipped — step 11 "Snapshot branch protection state" fails first, so steps 13 (the guard) and 14 (Aggregate & Summarize) never run. health-40 has failed on that step for four consecutive weekly runs (2026-07-06, -13, -20, -27). That looks like a token/permissions issue rather than a code defect, so it is out of scope here, but it means this guard is currently blind and the debt above accumulated unseen.

🤖 Generated with Claude Code

@cursor

cursor Bot commented Jul 31, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@coderabbitai

coderabbitai Bot commented Jul 31, 2026

Copy link
Copy Markdown

Warning

Review limit reached

You’ve reached a temporary PR review limit under our Fair Usage Limits Policy.

Your recent review volume is higher than typical usage, so adaptive limits are currently applied.

Next review available in: 26 minutes

Your organization has reached its usage spending cap. Adjust your spending cap in the billing tab.

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro

Run ID: 6cc54e5d-7f48-43af-b535-6d6b79c0838a

📥 Commits

Reviewing files that changed from the base of the PR and between 090a222 and 0c0a67f.

📒 Files selected for processing (3)
  • .gitignore
  • config/root-allowlist.txt
  • langsmith-fleet-worker-attempt.json

Comment @coderabbitai help to get the list of available commands.

@stranske
stranske enabled auto-merge (squash) July 31, 2026 16:03

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 989699f791

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread .gitignore
*.patch
coverage-local.*
pytest-junit*.xml
langsmith-fleet-worker-attempt.json

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Propagate the artifact exclusion to consumer repositories

When reusable-codex-run.yml executes for a consumer, agent-run-base checks out that consumer at the workspace root, the artifact step writes this file there, and the later commit step runs git add -A. This ignore rule exists only in the Workflows root; templates/consumer-repo/.gitignore and the canonical patterns used by sync_status_file_ignores.py still omit it, so consumer runs will continue committing the per-run artifact. Add it to the consumer status-file block and fallback patterns for propagation, or explicitly unstage it in the reusable runner.

AGENTS.md reference: AGENTS.md:L39-L41

Useful? React with 👍 / 👎.

langsmith-fleet-worker-attempt.json is written per-run by
reusable-codex-run.yml:1173 and uploaded as a build artifact; nothing reads it
from the repo. While tracked, every run that rewrote it produced a diff that
codex-autofix then committed onto whatever PR happened to be open — two such
commits landed on PR #2852 while it was in review.

Remove it and add it to the existing .gitignore block for per-run CI snapshots.

It was also not on config/root-allowlist.txt, which health-40's "Root allowlist
guard" enforces. While auditing that, four other tool-mandated root config files
turned out to be unlisted as well, so add them: .coderabbit.yaml,
.release-please-manifest.json, release-please-config.json, renovate.json. The
guard has not been reporting any of this because it is skipped — the earlier
"Snapshot branch protection state" step fails first (see PR body).

Deliberately NOT changed: testgen_gate.py (a one-off #2620 acceptance gate,
referenced by nothing) is left for an explicit keep-or-delete decision rather
than silently blessed by an allowlist entry.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@stranske-keepalive

Copy link
Copy Markdown
Contributor

Automated Status Summary

Head SHA: 4adafa8
Latest Runs: ⏳ pending — Gate
Required contexts: Gate / gate, Health 45 Agents Guard / guard
Required: core tests (3.12): ⏳ pending, core tests (3.13): ⏳ pending, docker smoke: ⏳ pending, gate: ⏳ pending

Workflow / Job Result Logs
(no jobs reported) ⏳ pending

Coverage Overview

  • Coverage history entries: 0

Updated automatically; will refresh on subsequent CI/Docker completions.


Keepalive checklist

Scope

No scope information available

Tasks

  • No tasks defined

Acceptance criteria

  • No acceptance criteria defined

@stranske
stranske merged commit 96502b9 into main Jul 31, 2026
39 checks passed
@stranske
stranske deleted the chore/untrack-langsmith-worker-attempt-artifact branch July 31, 2026 16:16
stranske added a commit that referenced this pull request Aug 1, 2026
Restores mergeability. The only true conflict was langsmith-fleet-worker-attempt.json,
a per-run artifact this branch modified and main untracked in #2856
("chore: untrack the per-run langsmith worker-attempt artifact"); main's deletion
is taken, dropping the out-of-scope artifact from this PR.

Both agents-auto-pilot.yml copies merged cleanly: main's only change since the
merge base was the actions/setup-python v6 -> v7 SHA bump, which is preserved
alongside this branch's handoff-safeguard changes. Root and consumer-template
copies remain byte-identical.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant