Skip to content

fix(ai-eval): use bash globstar to find all test files#196

Merged
janhesters merged 1 commit intomainfrom
fix/ai-eval-glob-all-tests
Apr 16, 2026
Merged

fix(ai-eval): use bash globstar to find all test files#196
janhesters merged 1 commit intomainfrom
fix/ai-eval-glob-all-tests

Conversation

@janhesters
Copy link
Copy Markdown
Collaborator

Summary

  • The previous fix (fix(ai-eval): run all skill evals in nightly workflow #195) used a quoted glob that riteway ai tried to open as a literal path, causing ENOENT on the runner.
  • Use bash -c 'shopt -s globstar; for f in ...' to properly expand **/*-test.sudo and run each file individually.
  • Stops on first failure via || exit 1.

Test plan

  • Trigger workflow manually via workflow_dispatch and verify all 10 .sudo files are found and executed

Use bash globstar to iterate all *-test.sudo files across ai-evals/
subdirectories, so every skill eval runs in the nightly workflow.
@janhesters janhesters merged commit 35cecd5 into main Apr 16, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant