Skip to content

Add model comparison diagnostics and hypothesis replay ranking#2534

Merged
FlorianPfaff merged 3 commits into
mainfrom
codex/pyrecest-model-comparison-hypothesis-replay-20260604
Jun 4, 2026
Merged

Add model comparison diagnostics and hypothesis replay ranking#2534
FlorianPfaff merged 3 commits into
mainfrom
codex/pyrecest-model-comparison-hypothesis-replay-20260604

Conversation

@FlorianPfaff
Copy link
Copy Markdown
Owner

Summary

  • add dataframe-oriented model-comparison evidence margin helpers
  • add hypothesis replay ranking utilities for tracking workflows
  • document and export the new APIs

Validation

  • python -m py_compile ... on touched Python files
  • git diff --check

Per request, no test suite was run.

@FlorianPfaff FlorianPfaff enabled auto-merge (squash) June 4, 2026 14:17
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

MegaLinter analysis: Success

Descriptor Linter Files Fixed Errors Warnings Elapsed time
✅ COPYPASTE jscpd yes no no 64.47s
✅ JSON prettier 7 0 0 0 0.64s
✅ JSON v8r 7 0 0 5.56s
✅ MARKDOWN markdownlint 68 0 0 0 1.88s
✅ MARKDOWN markdown-table-formatter 68 0 0 0 0.86s
✅ PYTHON black 814 24 0 0 56.51s
✅ PYTHON isort 814 30 0 0 3.6s
✅ REPOSITORY checkov yes no no 45.35s
✅ REPOSITORY gitleaks yes no no 10.27s
✅ REPOSITORY git_diff yes no no 0.09s
✅ REPOSITORY secretlint yes no no 25.16s
✅ REPOSITORY syft yes no no 2.86s
✅ REPOSITORY trivy-sbom yes no no 5.85s
✅ REPOSITORY trufflehog yes no no 26.39s
✅ YAML prettier 11 0 0 0 0.74s
✅ YAML v8r 11 0 0 11.15s
✅ YAML yamllint 11 0 0 0.46s

Notices

📣 MegaLinter 9.5.0 is out! Discover the new features and security recommendations in the release announcement. (Skip this info by defining SECURITY_SUGGESTIONS: false)

See detailed reports in MegaLinter artifacts

Your project could benefit from a custom flavor, which would allow you to run only the linters you need, and thus improve runtime performances. (Skip this info by defining FLAVOR_SUGGESTIONS: false)

  • Documentation: Custom Flavors
  • Command: npx mega-linter-runner@9.5.0 --custom-flavor-setup --custom-flavor-linters PYTHON_BLACK,PYTHON_ISORT,COPYPASTE_JSCPD,JSON_V8R,JSON_PRETTIER,MARKDOWN_MARKDOWNLINT,MARKDOWN_MARKDOWN_TABLE_FORMATTER,REPOSITORY_CHECKOV,REPOSITORY_GIT_DIFF,REPOSITORY_GITLEAKS,REPOSITORY_SECRETLINT,REPOSITORY_SYFT,REPOSITORY_TRIVY_SBOM,REPOSITORY_TRUFFLEHOG,YAML_PRETTIER,YAML_YAMLLINT,YAML_V8R

MegaLinter is graciously provided by OX Security
Show us your support by starring ⭐ the repository

@FlorianPfaff FlorianPfaff merged commit 6beaf5b into main Jun 4, 2026
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant