Skip to content

acc: hard-fail when change detection diff fails#6057

Merged
denik merged 1 commit into
mainfrom
denik/change-detection-hard-fail
Jul 24, 2026
Merged

acc: hard-fail when change detection diff fails#6057
denik merged 1 commit into
mainfrom
denik/change-detection-hard-fail

Conversation

@denik

@denik denik commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Why

Follow-up to #6047, which made selectChangedLocalTests fail open (log a warning and continue) when git diff --merge-base origin/main fails. Fail-open was a temporary concession so integration runs (DATABRICKS_TEST_SKIPLOCAL=withchanged) wouldn't break from a checkout without origin/main. Now that every caller fetches origin/main, a failed diff should abort loudly again — otherwise a missing origin/main silently disables change detection and lets newly added tests skip.

Changes

  • selectChangedLocalTests: revert the t.Logf + return nil back to t.Fatalf.

  • Do not merge until the eng-dev-ecosystem integration workflow provides origin/main in the CLI checkout; otherwise integration runs will hard-fail again.

@denik
denik requested review from janniklasrose and pietern July 24, 2026 09:17
@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Jul 24, 2026

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 67509e5

Run: 30085097933

Env 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 4 4 322 1059 11:05
💚​ aws windows 4 4 324 1057 7:29
💚​ azure linux 4 4 322 1058 11:55
💚​ azure windows 4 4 324 1056 8:32
💚​ gcp linux 1 5 321 1060 11:49
🔄​ gcp windows 1 1 5 322 1058 9:37
9 interesting tests: 4 RECOVERED, 4 SKIP, 1 flaky
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🔄​ TestSyncIncrementalSyncFileToPythonNotebook ✅​p ✅​p ✅​p ✅​p ✅​p 🔄​f
💚​ TestFetchRepositoryInfoAPI_FromRepo 💚​R 💚​R 💚​R 💚​R 🙈​S 🙈​S
💚​ TestFetchRepositoryInfoAPI_FromRepo/root 💚​R 💚​R 💚​R 💚​R
💚​ TestFetchRepositoryInfoAPI_FromRepo/subdir 💚​R 💚​R 💚​R 💚​R
Top 17 slowest tests (at least 2 minutes):
duration env testname
3:41 gcp linux TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform
3:22 azure windows TestAccept
3:20 aws windows TestAccept
3:18 gcp windows TestAccept
3:15 azure windows TestFilerWorkspaceFilesExtensionsStat
2:55 azure windows TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform
2:50 aws windows TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform
2:41 gcp linux TestFilerRecursiveDelete/workspace_files
2:35 aws linux TestImportDirDoesNotOverwrite
2:33 gcp windows TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=direct
2:28 azure linux TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform
2:26 aws linux TestFilerRecursiveDelete/workspace_files
2:26 aws windows TestImportDirDoesNotOverwrite
2:19 gcp windows TestFilerWorkspaceFilesExtensionsReadDir
2:18 azure linux TestFilerWorkspaceNotebook/pyNb.py
2:09 aws linux TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform
2:08 aws linux TestFilerWorkspaceFilesExtensionsReadDir

Revert the fail-open from #6047 now that every caller (push.yml PR cells
and integration runs) fetches origin/main. A failed
`git diff --merge-base origin/main` should abort loudly instead of
silently disabling change detection and letting new tests skip.
@denik
denik force-pushed the denik/change-detection-hard-fail branch from de50f6b to 67509e5 Compare July 24, 2026 10:07
@denik
denik enabled auto-merge July 24, 2026 10:37
@denik
denik added this pull request to the merge queue Jul 24, 2026
Merged via the queue into main with commit 303f0ff Jul 24, 2026
25 checks passed
@denik
denik deleted the denik/change-detection-hard-fail branch July 24, 2026 11:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants