-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-2610] upgrade to version 2.2.0 #3553
Conversation
This closes #3394
This closes #3381
Transform expansion and translation for the involved primitive transforms. Of course, the current PR will only work after the respective Dataflow worker and backend changes are released.
If a Write operation in streaming requests runner-determined sharding, make the Dataflow runner default to maxNumWorkers * 2 shards.
Previously CallablePTransform was being used both as the factory and the transform itself, which could result in state getting carried between pipelines.
R: @takidau @xumingming |
Can you please stage the second PR as a branch that builds on this one first? I don't want the branch to be left in a broken state for too long. |
I create a draft PR #3554 there, as far as I know that's just a simple version change. |
Thanks, merging. |
Merged. |
Thanks! |
Respect non-retryable error codes from Datastore. Add unit tests to check that retryable errors are retried.
@takidau I'm afraid the merge of this task has some issues, or maybe I'm using the wrong method. --I tried to create a pull request from DSL_SQL based on Master, in web page, and it's shown as 'Can’t automatically merge'. I see lots of files from master branch will be listed. |
Changes Unknown when pulling e8c5574 on master into ** on DSL_SQL**. |
Revert "[BEAM-2610] This closes apache#3553"
As described in task BEAM-2610, this is the first PR to do the job. Feel free to merge it if no mis-operation during creating the PR as any issues are supposed to be fixed in the second PR.
Btw, the failure is expected as dsl/sql is still using
2.1.0-SNAPSHOT
, and be fixed in PR 2