Skip to content

Comments

[enhancement](stream load pipe) using queryid or load id to identify stream load pipe instead of fragment instance id#17362

Merged
yiguolei merged 2 commits intoapache:masterfrom
yiguolei:add_query_id_to_load
Mar 4, 2023
Merged

[enhancement](stream load pipe) using queryid or load id to identify stream load pipe instead of fragment instance id#17362
yiguolei merged 2 commits intoapache:masterfrom
yiguolei:add_query_id_to_load

Conversation

@yiguolei
Copy link
Contributor

@yiguolei yiguolei commented Mar 2, 2023

Proposed changes

NewLoadStreamMgr already has pipe and other info. Do not need save the pipe into fragment state. and FragmentState should be more clear.

But this pr will change the behaviour of BE.
I will pick the pr to doris 1.2.3 and add the load id to FE support. The user could upgrade from 1.2.3 to 2.x

Problem summary

Describe your changes.

Checklist(Required)

  • Does it affect the original behavior
  • Has unit tests been added
  • Has document been added or modified
  • Does it need to update dependencies
  • Is this PR support rollback (If NO, please explain WHY)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@github-actions github-actions bot added the area/planner Issues or PRs related to the query planner label Mar 2, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Mar 2, 2023

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
@github-actions
Copy link
Contributor

github-actions bot commented Mar 2, 2023

clang-tidy review says "All clean, LGTM! 👍"

@yiguolei
Copy link
Contributor Author

yiguolei commented Mar 2, 2023

./run buildall

@github-actions
Copy link
Contributor

github-actions bot commented Mar 2, 2023

clang-tidy review says "All clean, LGTM! 👍"

@yiguolei yiguolei force-pushed the add_query_id_to_load branch from eaae6dd to d7a9163 Compare March 3, 2023 03:39
@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2023

clang-tidy review says "All clean, LGTM! 👍"

@yiguolei yiguolei force-pushed the add_query_id_to_load branch from d7a9163 to f25d259 Compare March 3, 2023 07:31
@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2023

clang-tidy review says "All clean, LGTM! 👍"

2 similar comments
@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2023

clang-tidy review says "All clean, LGTM! 👍"

@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2023

clang-tidy review says "All clean, LGTM! 👍"

@yiguolei yiguolei force-pushed the add_query_id_to_load branch from 66f2aac to 55d2612 Compare March 3, 2023 09:12
@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2023

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2023

clang-tidy review says "All clean, LGTM! 👍"

@yiguolei
Copy link
Contributor Author

yiguolei commented Mar 3, 2023

./run buildall

@yiguolei
Copy link
Contributor Author

yiguolei commented Mar 3, 2023

./run p0

@yiguolei yiguolei force-pushed the add_query_id_to_load branch from e2f72d9 to b0c95ce Compare March 4, 2023 00:25
@yiguolei
Copy link
Contributor Author

yiguolei commented Mar 4, 2023

./run buildall

@github-actions
Copy link
Contributor

github-actions bot commented Mar 4, 2023

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

@chenlinzhong chenlinzhong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 4, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Mar 4, 2023

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 4, 2023

PR approved by anyone and no changes requested.

@yiguolei yiguolei merged commit b9b0280 into apache:master Mar 4, 2023
morningman pushed a commit that referenced this pull request Mar 6, 2023
…stream load pipe instead of fragment instance id (#17439)

cherry-pick part of #17362

This PR does not affect load behavior, just add load id to Protobuf Message.
So user could upgrade to 2.x from 1.2.3 smoothly.
yagagagaga pushed a commit to yagagagaga/doris that referenced this pull request Mar 9, 2023
…stream load pipe instead of fragment instance id (apache#17362)

* [enhancement](stream load pipe) using queryid or load id to identify stream load pipe instead of fragment instance id

NewLoadStreamMgr already has pipe and other info. Do not need save the pipe into fragment state. and FragmentState should be more clear.

But this pr will change the behaviour of BE.
I will pick the pr to doris 1.2.3 and add the load id to FE support. The user could upgrade from 1.2.3 to 2.x
Co-authored-by: yiguolei <yiguolei@gmail.com>
gnehil pushed a commit to gnehil/doris that referenced this pull request Apr 21, 2023
…stream load pipe instead of fragment instance id (apache#17362)

* [enhancement](stream load pipe) using queryid or load id to identify stream load pipe instead of fragment instance id

NewLoadStreamMgr already has pipe and other info. Do not need save the pipe into fragment state. and FragmentState should be more clear.

But this pr will change the behaviour of BE.
I will pick the pr to doris 1.2.3 and add the load id to FE support. The user could upgrade from 1.2.3 to 2.x
Co-authored-by: yiguolei <yiguolei@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/planner Issues or PRs related to the query planner reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants