Skip to content

[fix](dynamic) set dynamic partition scheduler daemon sleep time automaticly#14041

Closed
nextdreamblue wants to merge 1 commit intoapache:masterfrom
nextdreamblue:dynamic_interval_seconds
Closed

[fix](dynamic) set dynamic partition scheduler daemon sleep time automaticly#14041
nextdreamblue wants to merge 1 commit intoapache:masterfrom
nextdreamblue:dynamic_interval_seconds

Conversation

@nextdreamblue
Copy link
Contributor

@nextdreamblue nextdreamblue commented Nov 7, 2022

Signed-off-by: nextdreamblue zxw520blue1@163.com

Proposed changes

Issue Number: close #13999

Problem summary

Describe your changes.

Checklist(Required)

  1. Does it affect the original behavior:
    • Yes
    • No
    • I don't know
  2. Has unit tests been added:
    • Yes
    • No
    • No Need
  3. Has document been added or modified:
    • Yes
    • No
    • No Need
  4. Does it need to update dependencies:
    • Yes
    • No
  5. Are there any changes that cannot be rolled back:
    • Yes (If Yes, please explain WHY)
    • No

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@hello-stephen
Copy link
Contributor

hello-stephen commented Nov 7, 2022

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 34.64 seconds
stream load tsv: 462 seconds loaded 74807831229 Bytes, about 154 MB/s
stream load json: 38 seconds loaded 2358488459 Bytes, about 59 MB/s
stream load orc: 67 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 28 seconds loaded 861443392 Bytes, about 29 MB/s
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230228101925_clickbench_pr_105623.html

@nextdreamblue nextdreamblue force-pushed the dynamic_interval_seconds branch 3 times, most recently from 94c24d5 to 10c0a84 Compare November 8, 2022 11:38
@nextdreamblue nextdreamblue changed the title [Enhancement](Dynamic) set dynamic partition scheduler daemon sleep t… [fix](dynamic) set dynamic partition scheduler daemon sleep time automaticly Nov 19, 2022
@nextdreamblue nextdreamblue force-pushed the dynamic_interval_seconds branch from 10c0a84 to fcad7c1 Compare January 16, 2023 06:28
@nextdreamblue nextdreamblue force-pushed the dynamic_interval_seconds branch from fcad7c1 to c2fea18 Compare February 8, 2023 11:23
…ime automaticly

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
@nextdreamblue nextdreamblue force-pushed the dynamic_interval_seconds branch from c2fea18 to 3f9852f Compare February 9, 2023 10:38
@nextdreamblue
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

We're closing this PR because it hasn't been updated in a while.
This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag!

@github-actions github-actions bot added the Stale label Aug 28, 2023
@github-actions github-actions bot closed this Aug 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

以小时自动创建分区,分区创建的时间越来越迟,最后可能第一个按小时的分区不会创建导致数据丢失

2 participants