Skip to content

Enrichment in connectors#16

Merged
shubhobm merged 6 commits intomainfrom
feat/enrich-terminology-connectors
Feb 24, 2026
Merged

Enrichment in connectors#16
shubhobm merged 6 commits intomainfrom
feat/enrich-terminology-connectors

Conversation

@shubhobm
Copy link
Copy Markdown
Contributor

Summary

This PR strengthens the new enrich path by adding targeted connector tests and ensuring release-time CI runs tests as well.

What changed

1) New/updated unit tests for enrich functionality

  • Added tests/unit/connectors/test_enrich_utils.py
    • Verifies deployer normalization to OpenAI for GPT models.
    • Verifies deployer normalization to Together AI for together/* deployers.
  • Added tests/unit/connectors/test_garak.py
    • Verifies Garak metric normalization emits publish-compatible dict-shaped results (results.rows).
    • Verifies columnar metric normalization behavior.
  • Updated tests/unit/connectors/test_inspect.py
    • Adds coverage for convert_eval_log(..., enrich=True).
    • Adds unresolved benchmark behavior coverage (UnsupportedInspectBenchmarkError path).

2) CI/CD workflow updates for release testing

  • Updated .github/workflows/test.yml
    • Tests now run on:
      • pull_request to main (existing)
      • release.published (new)

3) Publish workflow release behavior

  • Updated .github/workflows/publish.yml
    • On release, if tag version != pyproject.toml version:
      • auto-aligns version in workflow (poetry version <tag_version>)
      • continues test/lint/typecheck/build/publish in same run
    • Removed blocking "create PR and stop" mismatch behavior.

4) Documentation

  • Updated README.md with a Release behavior section documenting:
    • release-time checks
    • tag/version alignment behavior
    • publish flow expectation

Validation

Executed locally:

poetry env use python3.12
poetry run pytest -q

@shubhobm shubhobm merged commit 10d140f into main Feb 24, 2026
1 check passed
@shubhobm shubhobm deleted the feat/enrich-terminology-connectors branch February 24, 2026 07:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant