[fix](routine load) fix incorrect auto-resume interval caused by excessive auto-resume attempts#47528
Merged
dataroaring merged 1 commit intoapache:masterfrom Feb 12, 2025
Merged
Conversation
Contributor
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
Contributor
Author
|
run buildall |
TPC-H: Total hot run time: 32695 ms |
TPC-DS: Total hot run time: 191995 ms |
ClickBench: Total hot run time: 31.1 s |
Contributor
|
PR approved by at least one committer and no changes requested. |
Contributor
|
PR approved by anyone and no changes requested. |
liaoxin01
reviewed
Feb 10, 2025
fe/fe-core/src/main/java/org/apache/doris/load/routineload/ScheduleRule.java
Outdated
Show resolved
Hide resolved
883dcf3 to
eda8d63
Compare
Contributor
Author
|
run buildall |
eda8d63 to
06fa316
Compare
Contributor
Author
|
run buildall |
06fa316 to
58494fb
Compare
Contributor
Author
|
run buildall |
TPC-H: Total hot run time: 31866 ms |
TPC-DS: Total hot run time: 190581 ms |
ClickBench: Total hot run time: 31.42 s |
Contributor
|
PR approved by at least one committer and no changes requested. |
liaoxin01
approved these changes
Feb 12, 2025
github-actions bot
pushed a commit
that referenced
this pull request
Feb 12, 2025
…ssive auto-resume attempts (#47528) Incorrect auto-resume interval observed when autoResumeCount is too large. Logs show that when autoResumeCount reaches high values, the auto-resume interval becomes approximately 20 seconds instead of the expected 5 minutes. ``` 2025-02-05 14:58:46,830 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738701821, autoResumeCount: 41555, pause reason: PARTITIONS_ERR 2025-02-05 14:59:11,837 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738726830, autoResumeCount: 41556, pause reason: PARTITIONS_ERR 2025-02-05 14:59:36,844 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738751837, autoResumeCount: 41557, pause reason: PARTITIONS_ERR ```
github-actions bot
pushed a commit
that referenced
this pull request
Feb 12, 2025
…ssive auto-resume attempts (#47528) Incorrect auto-resume interval observed when autoResumeCount is too large. Logs show that when autoResumeCount reaches high values, the auto-resume interval becomes approximately 20 seconds instead of the expected 5 minutes. ``` 2025-02-05 14:58:46,830 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738701821, autoResumeCount: 41555, pause reason: PARTITIONS_ERR 2025-02-05 14:59:11,837 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738726830, autoResumeCount: 41556, pause reason: PARTITIONS_ERR 2025-02-05 14:59:36,844 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738751837, autoResumeCount: 41557, pause reason: PARTITIONS_ERR ```
lzyy2024
pushed a commit
to lzyy2024/doris
that referenced
this pull request
Feb 21, 2025
…ssive auto-resume attempts (apache#47528) Incorrect auto-resume interval observed when autoResumeCount is too large. Logs show that when autoResumeCount reaches high values, the auto-resume interval becomes approximately 20 seconds instead of the expected 5 minutes. ``` 2025-02-05 14:58:46,830 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738701821, autoResumeCount: 41555, pause reason: PARTITIONS_ERR 2025-02-05 14:59:11,837 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738726830, autoResumeCount: 41556, pause reason: PARTITIONS_ERR 2025-02-05 14:59:36,844 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738751837, autoResumeCount: 41557, pause reason: PARTITIONS_ERR ```
koarz
pushed a commit
to koarz/doris
that referenced
this pull request
Jun 4, 2025
…ssive auto-resume attempts (apache#47528) Incorrect auto-resume interval observed when autoResumeCount is too large. Logs show that when autoResumeCount reaches high values, the auto-resume interval becomes approximately 20 seconds instead of the expected 5 minutes. ``` 2025-02-05 14:58:46,830 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738701821, autoResumeCount: 41555, pause reason: PARTITIONS_ERR 2025-02-05 14:59:11,837 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738726830, autoResumeCount: 41556, pause reason: PARTITIONS_ERR 2025-02-05 14:59:36,844 INFO (Routine load scheduler|187) [ScheduleRule.isNeedAutoSchedule():83] try to auto reschedule routine load 10103, latestResumeTimestamp: 1738738751837, autoResumeCount: 41557, pause reason: PARTITIONS_ERR ```
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Incorrect auto-resume interval observed when autoResumeCount is too large. Logs show that when autoResumeCount reaches high values, the auto-resume interval becomes approximately 20 seconds instead of the expected 5 minutes.
Release note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)