[test](regression) Add warmup mixed-mode coverage and debug observabi… by pingchunzhang · Pull Request #65153 · apache/doris

pingchunzhang · 2026-07-02T07:55:45Z

…lity

What problem does this PR solve?

Issue Number: None

Related PR: None

Problem Summary: Add FE-side warmup diagnostics for lock blocking, periodic reschedule, and VCG-driven reconciliation paths, and add docker regression coverage for mixed warmup/VCG concurrency, conflict, failover, restart, and queue semantics. This makes the new warmup rules observable and gives regression coverage for the main mixed-mode scenarios without bringing markdown or generated artifacts into the commit.

Release note

None

Check List (For Author)

Test: No need to test (user explicitly asked not to run FE UT/regression in this round)
Behavior changed: Yes (adds FE debug observability and new regression coverage)
Does this need documentation: No

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

…lity ### What problem does this PR solve? Issue Number: None Related PR: None Problem Summary: Add FE-side warmup diagnostics for lock blocking, periodic reschedule, and VCG-driven reconciliation paths, and add docker regression coverage for mixed warmup/VCG concurrency, conflict, failover, restart, and queue semantics. This makes the new warmup rules observable and gives regression coverage for the main mixed-mode scenarios without bringing markdown or generated artifacts into the commit. ### Release note None ### Check List (For Author) - Test: No need to test (user explicitly asked not to run FE UT/regression in this round) - Behavior changed: Yes (adds FE debug observability and new regression coverage) - Does this need documentation: No

hello-stephen · 2026-07-02T07:55:52Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

pingchunzhang · 2026-07-02T08:00:30Z

/review

github-actions · 2026-07-02T08:11:41Z

PR approved by at least one committer and no changes requested.

github-actions · 2026-07-02T08:11:43Z

PR approved by anyone and no changes requested.

pingchunzhang · 2026-07-02T08:41:16Z

+                                + "createdPeriodicJobId={} createdEventJobId={} oldJobIds={}",
+                        virtualGroupInFe.getName(), srcCg, dstCg, jobIdPeriodic, jobIdEvent, jobIdsInMs);
                LOG.info("virtual compute group {}, generate new jobIds periodic={}, event={}, and old jobIds {}",
                        virtualGroupInFe, jobIdPeriodic, jobIdEvent, jobIdsInMs);


merge this two logs

pingchunzhang · 2026-07-02T08:41:26Z

+                                + "failureReason={}",
+                        virtualGroupInFe.getName(), srcCg, dstCg, jobIdsInMs, e.getMessage(), e);
                LOG.warn("virtual compute err, name: {}, failed to generate file cache warm up jobs: {}",
                        virtualGroupInFe.getName(), e.getMessage(), e);


pingchunzhang · 2026-07-02T08:44:47Z

+                            + "subComputeGroups={} matchedJobIds={} cancelReason={}",
+                    virtualComputeGroupName, activeComputeGroup, standbyComputeGroup,
+                    subComputeGroups, matchedJobIds, cancelReason);
+        }


remove this codes

pingchunzhang · 2026-07-02T08:46:10Z

    public boolean tryRegisterRunningJob(CloudWarmUpJob job) {
        if (job.isEventDriven()) {
            // Event-driven jobs do not require registration, always allow
+            LOG.info("warmup-lock register-skip jobId={} srcCluster={} dstCluster={} syncMode={} jobType={} "


use debug level

pingchunzhang · 2026-07-02T08:47:24Z

-            LOG.info("Job {} skipped: waiting for job {} to finish on destination cluster {}",
-                    jobId, existingJobId, clusterName);
+        if (success) {
+            LOG.info("warmup-lock register jobId={} srcCluster={} dstCluster={} syncMode={} jobType={} "


use debug level

pingchunzhang · 2026-07-02T08:47:33Z

+                    jobId, job.getSrcClusterName(), clusterName, job.getSyncMode(), job.getJobType(),
+                    existingJobId, "success");
+        } else {
+            LOG.debug("warmup-lock register jobId={} srcCluster={} dstCluster={} syncMode={} jobType={} "


use info level

pingchunzhang · 2026-07-02T08:47:49Z

    private boolean deregisterRunningJob(CloudWarmUpJob job) {
        if (job.isEventDriven()) {
            // Event-driven jobs are not registered, so nothing to deregister
+            LOG.info("warmup-lock deregister-skip jobId={} srcCluster={} dstCluster={} syncMode={} jobType={} "


pingchunzhang · 2026-07-02T08:50:12Z

+        if (!affectedJobIds.isEmpty()) {
+            LOG.info("warmup-system-cancel triggerType=CLUSTER_CHANGE clusterName={} affectedJobIds={} reason={}",
+                    clusterName, affectedJobIds, reason);
+        }


useless code. remove

### What problem does this PR solve? Issue Number: close apache#65153 Related PR: apache#65153 Problem Summary: The PR review pointed out duplicate warmup rebuild logs, redundant pre-scan logging before cancellation, and noisy log levels in warmup job registration. This change keeps the structured rebuild logs, removes redundant pre-scan log-only loops, and adjusts warmup lock logs to the requested debug/info levels. ### Release note None ### Check List (For Author) - Test: FE checkstyle - mvn checkstyle:check -pl fe-core - Behavior changed: No - Does this need documentation: No

pingchunzhang requested a review from gavinchou as a code owner July 2, 2026 07:55

gavinchou previously approved these changes Jul 2, 2026

View reviewed changes

github-actions Bot added the approved Indicates a PR has been approved by one committer. label Jul 2, 2026

github-actions Bot added the reviewed label Jul 2, 2026

pingchunzhang commented Jul 3, 2026

View reviewed changes

pingchunzhang dismissed gavinchou’s stale review via 9144f6b July 3, 2026 07:57

github-actions Bot removed the approved Indicates a PR has been approved by one committer. label Jul 3, 2026

Merge branch 'master' into master

b597e55

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[test](regression) Add warmup mixed-mode coverage and debug observabi…#65153

[test](regression) Add warmup mixed-mode coverage and debug observabi…#65153
pingchunzhang wants to merge 3 commits into
apache:masterfrom
pingchunzhang:master

pingchunzhang commented Jul 2, 2026

Uh oh!

hello-stephen commented Jul 2, 2026

Uh oh!

pingchunzhang commented Jul 2, 2026

Uh oh!

github-actions Bot commented Jul 2, 2026

Uh oh!

github-actions Bot commented Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

pingchunzhang Jul 2, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

pingchunzhang commented Jul 2, 2026

What problem does this PR solve?

Release note

Check List (For Author)

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Jul 2, 2026

Uh oh!

pingchunzhang commented Jul 2, 2026

Uh oh!

github-actions Bot commented Jul 2, 2026

Uh oh!

github-actions Bot commented Jul 2, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants