Skip to content

FIX: Fixes for failing integration tests#1539

Merged
varunj-msft merged 1 commit intomicrosoft:mainfrom
varunj-msft:varunj-msft/Integration-Test-Fix
Mar 25, 2026
Merged

FIX: Fixes for failing integration tests#1539
varunj-msft merged 1 commit intomicrosoft:mainfrom
varunj-msft:varunj-msft/Integration-Test-Fix

Conversation

@varunj-msft
Copy link
Copy Markdown
Contributor

Description

Fixes 47 failing integration tests in the ADO CI pipeline to unblock the v0.12.0 release.

  1. Bug fixes in test_seed_dataset_provider_integration.py:

    • Added missing await on get_all_dataset_names_async() calls, converted sync tests to async
    • Fixed sizes= to size= matching SeedDatasetMetadata field name
    • Replaced initialize_pyrit_async with sqlite_instance fixture to fix stale singleton DB
  2. Skip API key tests (29 failures): Added @pytest.mark.run_only_if_all_tests to tests in test_targets_and_secrets.py, test_azure_content_filter_integration.py, and test_openai_embedding.py that require API keys. Entra auth equivalents still run. test_connect_required_aml_text_targets and test_connect_openai_completion intentionally left unmarked.

  3. Skip notebooks (5 failures): Added to skipped_files in 5 notebook test files for notebooks requiring credentials unavailable in CI. Underlying code covered by Entra auth tests.

Tests and Documentation

Test-only changes. Verified locally: all previously-failing tests now pass or are cleanly skipped. No doc changes needed.

Copy link
Copy Markdown
Collaborator

@spencrr spencrr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good - nonblocking on when we re-enable, to use entra auth if we have that setup!

@varunj-msft varunj-msft merged commit e49b4f3 into microsoft:main Mar 25, 2026
38 checks passed
@varunj-msft varunj-msft deleted the varunj-msft/Integration-Test-Fix branch March 25, 2026 22:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants