[pull] master from apache:master#377
Merged
pull[bot] merged 47 commits intoVf87:masterfrom Feb 27, 2021
Merged
Conversation
… upon reference invalidation instead of expensive set management. Reduce operations of shared cache by caching per-key object sets locally and flushing as groups to shared cache. Remove byte tracking which could be racy based upon background evictions in favor of just iterating for rendering the status page. This also lets us capture more stats. Additionally fix a caching issue with IdTracker where a immutable EmptyMap could be attempted to be modified.
…ns/schemaio-expansion-service
…t custom window types
In Java these may differ (e.g. using InvalidWindows after merging).
…extensions/ml/build.gradle
…Parse and ParseFiles (#14078) * [BEAM-11861] Provide setCoder, withCoder methods in ParquetIO.Parse<T> and ParquetIO.ParseFiles<T> to provide explicit coder. * Added Unit test case * BEAM-11527 fixed oversight.
…use runner_v2. Do not stage dataflow worker jar when use runner_v2.
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/schemaio-expansion-service
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/sorter
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/ml
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/sketching
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/protobuf
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/kyro
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/join-library
[BEAM-10961] enable strict dependency checking for sdks/java/extensions/jackson
…and map to RUNNING
Attempting improvements on DirectRunner Python dash
…support for the Dataflow runner
…ns/google-cloud-platform-core (#14084) * [BEAM-10961] enable strict dependency checking for sdks/java/extensions/euphoria * [BEAM-10961] enable strict dependency checking for sdks/java/extensions/google-cloud-platform-core * [BEAM-10961] undo line moves (originally intended for alphabeticization) * [BEAM-10961] remove unintentionally added euphoria/build.gradle
…he invalidation to be based…
…ustom merging windows fn without custom window types Add validate runner test for testing custom merging windows fn without custom window types
* strict dependency checking for sdks/io/gcp * add compile(runners:core-java) since it was usedUndeclared * [BEAM-10961] suggested changes: better use of existing library variables, remove testImplementation line * reintroduce some dependencies but as runtimeOnly * remove stray space * [BEAM-10961] create variables for some grpc libraries * [BEAM-10961] add back compile+permitUnusedDeclared lines * [BEAM-10961] fix whitespace in comment block and uncomment enableStrictDependencies=true * [BEAM-10961] uncomment out permitUnusedDeclared - to show error in PR * remove trailing whitespace * [BEAM-10961] hardcode dependency in permitUnusedDeclared lines * [BEAM-10961] make commenting for BEAM-11761 consistent with other PRs * [BEAM-10961] use enforcedPlatform dependency to allow permitUnusedDeclared to support library.java.* variables * [BEAM-10961] (1) add reference to BEAM-11761 (2) fix spacing (3) permitUnusedDeclared library.java.proto_google_cloud_bigquerybeta2_storage_v1 * [BEAM-10961] (1) remove stray compile/permitUnusedDeclared pair added earlier (2) group compile project() declarations * [BEAM-10961] remove proto_google_cloud_bigquery_storage_v1beta1
…ZED_PROCESSING_TIME
Attempting improvements on DirectRunner Python dash
[BEAM-2914] Add portable merging window support to Python ULR.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
9 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )