Skip to content

feat(guardrails): パターンL–Oのテスト検証信頼性ガードを追加 - #291

Merged
terisuke merged 1 commit into
devfrom
test-reliability-guards
Aug 3, 2026
Merged

feat(guardrails): パターンL–Oのテスト検証信頼性ガードを追加#291
terisuke merged 1 commit into
devfrom
test-reliability-guards

Conversation

@terisuke

@terisuke terisuke commented Aug 3, 2026

Copy link
Copy Markdown

Summary

パターン

# 内容 手段
L SKIP 黙認を green と誤認 test-honesty.ts + /test-honesty
M worktree に node_modules 無し worktree-bootstrap.ts
N fireEvent 等で vacuous pass skill harness-api-gotcha + falsifiable-change
O ambient env でテストが分岐 env-hermetic.ts + skill env-hermetic-tests

受入(I)

  • 陰性: skip=0 / node_modules あり / vi.mock 済み → 助言なし
  • 陽性: DB skip / 欠如 node_modules / gate のみ → 助言
  • 反証: OPENCODE_*_GUARD=off で助言消える

Test plan

  • bun test test/plugin/test-reliability-guards.test.ts(17 pass)
  • local:deploy / local:check green
  • ライブ: L advisory / O violation+hermetic
  • CI green 後マージ

Closes #290

Made with Cursor

SKIP黙認・worktree未準備・ハーネスAPI制限・env密閉不足を、助言
plugin / command / skill / 結線ヘルパーで検出する。ハードブロック
はせず(I)、反証と陰性/陽性テストを同梱する。

Closes #290

Co-authored-by: Cursor <cursoragent@cursor.com>
@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown

This PR doesn't fully meet our contributing guidelines and PR template.

What needs to be fixed:

  • PR description is missing required template sections. Please use the PR template.

Please edit this PR description to address the above within 2 hours, or it will be automatically closed.

If you believe this was flagged incorrectly, please let a maintainer know.

@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown

The following comment was made by an LLM, it may be inaccurate:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(guardrails): patterns L-O — test verification gaps beyond A-K (env-dependent skips, worktree env, runner API limits, env-var instability)

1 participant