Skip to content

[CI] Decouple TPU CI tests to run in parallel with E2E Airflow tests#4401

Merged
copybara-service[bot] merged 1 commit into
mainfrom
jackyf/ci-test-parallel
Jul 10, 2026
Merged

[CI] Decouple TPU CI tests to run in parallel with E2E Airflow tests#4401
copybara-service[bot] merged 1 commit into
mainfrom
jackyf/ci-test-parallel

Conversation

@RexBearIU

@RexBearIU RexBearIU commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Description

This PR decouples the TPU unit/integration CI tests from the nightly image build workflow, allowing them to run in parallel with the TPU E2E Airflow tests once the TPU Docker images are pushed.

Specifically:

  • Adds a run_tests parameter (default true) to build_and_push_docker_image.yml to control whether unit/integration tests are run inside the build workflow.
  • Restructures nightly_images_pipeline.yml to disable nested CI tests during TPU builds (run_tests: false).
  • Adds a top-level run_tpu_ci_tests matrix job in nightly_images_pipeline.yml that runs the TPU unit/integration tests concurrently with run_e2e_tests (Airflow E2E tests).
  • Keeps GPU CI tests nested inside the GPU build job (default run_tests: true) as GPU does not trigger E2E tests.
  • Updates the notify_failure dependencies to monitor all top-level parallel steps.

Tests

  • Verified via execution run Run #29006178590, where the TPU CI and E2E Airflow tests triggered and completed in parallel while the GPU nightly builds were still running.

Checklist

  • I have performed a self-review of my code. For an optional AI review, add the gemini-review label.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run end-to-end tests tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed, including adding new documentation pages to the relevant Table of Contents (toctree directive) as explained in our documentation.

@codecov

codecov Bot commented Jul 9, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@RexBearIU RexBearIU force-pushed the jackyf/ci-test-parallel branch 2 times, most recently from b2fdbb2 to 3be6a9f Compare July 9, 2026 08:50
@RexBearIU RexBearIU force-pushed the jackyf/ci-test-parallel branch from 3be6a9f to 052fda6 Compare July 9, 2026 10:12
@RexBearIU RexBearIU changed the title [CI] Split TPU and GPU nightly builds to run E2E tests in parallel [CI] Decouple TPU CI tests to run in parallel with E2E Airflow tests Jul 9, 2026
@RexBearIU RexBearIU changed the title [CI] Decouple TPU CI tests to run in parallel with E2E Airflow tests [CI] Decouple TPU CI tests to run in parallel with E2E Airflow tests Jul 9, 2026
@copybara-service copybara-service Bot merged commit 96a71e7 into main Jul 10, 2026
66 checks passed
@copybara-service copybara-service Bot deleted the jackyf/ci-test-parallel branch July 10, 2026 06:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants