sync with open source how #118
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* [prism] Add basic processing time queue. * Initial residual handling refactor. * Re-work teststream initilization. Remove pending element race. * touch up * rm merge duplicate * Simplify watermark hold tracking. * First successful run! * Remove duplicated test run. * Deduplicate processing time heap. * rm debug text * Remove some debug prints, cleanup. * tiny todo cleanup * ProcessingTime workming most of the time! * Some cleanup * try to get github suite to pass #1 * touch * reduce counts a bit, filter tests some. * Clean up unrelated state changes. Clean up comments somewhat. * Filter out dataflow incompatible test. * Refine processing time event comment. * Remove test touch. --------- Co-authored-by: lostluck <13907733+lostluck@users.noreply.github.com>
… lower batching limit for rewrite operations which are copying. (#31410)
Signed-off-by: Jeffrey Kinard <jeff@thekinards.com>
…s data channel is busy
* Refactor RowMutationInformation to use string type * Remove unnecessary test * Add javadoc * Add segment too large test cases * Add hex based test cases to integration test
* Add ApplyBucketsWithInterpolation TFTransform * Update sdks/python/apache_beam/ml/transforms/tft.py Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com> * add tft documentation link * change docstring wording around bucket_boundaries * Update sdks/python/apache_beam/ml/transforms/tft.py Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com> --------- Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com>
This is useful for cases where the side input may be too large for our default caching infrastructure but the user would nonetheless prefer to spend the memory on keeping the entire object live. This can be especially useful for Maps, where it may be much more efficient than doing point lookups.
This is the first transform in the (alphabetical) list, so it'd be good to not have it empty. Also produce slightly nicer examples for repeated arguments.
* Update bigquery.py fix #31372 * fix lint
* Don't re-encode byte[] values in SortValues transform * checkstyle * Apply code review comments
* add support for FlinkJobServer configuration * remove hardcoded timeout for FlinkPortableClient
* Emit a warning when large elements are detected. * Reduce logging frequency * lint
* Use bytes. * Update sdks/python/apache_beam/runners/worker/data_plane.py
…#31713) * Remove testRuntimeMigration configuration for test-utils dependencies * Fix test dependency direct-java configuration
Co-authored-by: Lahari Guduru <lahariguduru@google.com>
* Add support for BasicAuth to Solace * Address PR comments * Use `checkStateNotNull`
This allows one to define new transforms with YAML that can be imported and used in other pipelines.
* Disable caching for one more workflow * Disable on setup-environment as well
jackson-datatype-joda already pulls joda-time 2.10.14. Sync version
* add missing transitive dependencies * Fix analyzeClassesDependencies
* Fix Python Playground Dockerfile * Update version to 11.0.23
grpc-census, grpc-protobuf-lite and grpc-xds are now part of the google_cloud_platform_libraries_bom
* Replace LGPL dep in Go SDK with an MIT alternative * Add update in CHANGES.md
Polish DoFn.Setup
…with legacy runner by building on top of MultimapState. (#31453)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Please add a meaningful description for your change here
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, commentfixes #<ISSUE NUMBER>instead.CHANGES.mdwith noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.