Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-13119] Subdirectory prefix tag for Go SDK #15881

Merged
merged 1 commit into from Nov 3, 2021

Conversation

lostluck
Copy link
Contributor

@lostluck lostluck commented Nov 3, 2021

Since the Beam's Go Module isn't in the repo root, additional subdirectory prefixed tags are required for proper release versioning. See https://golang.org/ref/mod#vcs-version for the description of the requirement.)

Leaving an explicit reference to https://issues.apache.org/jira/browse/BEAM-13119 in the script so the JIRA can retain context or updates for later.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

ValidatesRunner compliance status (on master branch)

Lang ULR Dataflow Flink Samza Spark Twister2
Go --- Build Status Build Status Build Status Build Status ---
Java Build Status Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Python --- Build Status
Build Status
Build Status
Build Status
Build Status
Build Status Build Status ---
XLang Build Status Build Status Build Status Build Status Build Status ---

Examples testing status on various runners

Lang ULR Dataflow Flink Samza Spark Twister2
Go --- --- --- --- --- --- ---
Java --- Build Status
Build Status
Build Status
--- --- --- --- ---
Python --- --- --- --- --- --- ---
XLang --- --- --- --- --- --- ---

Post-Commit SDK/Transform Integration Tests Status (on master branch)

Go Java Python
Build Status Build Status Build Status
Build Status
Build Status

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website Whitespace Typescript
Non-portable Build Status
Build Status
Build Status
Build Status
Build Status
Build Status Build Status Build Status Build Status
Portable --- Build Status Build Status --- --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests

See CI.md for more information about GitHub Actions CI.

@lostluck
Copy link
Contributor Author

lostluck commented Nov 3, 2021

R: @ibzib
I assume you had to explicitly push the tags for the RC1 you added, so largely I followed suit with that.

@lostluck lostluck requested a review from ibzib November 3, 2021 17:06
Copy link
Contributor

@ibzib ibzib left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@codecov
Copy link

codecov bot commented Nov 3, 2021

Codecov Report

Merging #15881 (a79d493) into master (526359b) will increase coverage by 0.01%.
The diff coverage is 97.18%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #15881      +/-   ##
==========================================
+ Coverage   83.49%   83.51%   +0.01%     
==========================================
  Files         445      445              
  Lines       61305    61365      +60     
==========================================
+ Hits        51189    51251      +62     
+ Misses      10116    10114       -2     
Impacted Files Coverage Δ
sdks/python/apache_beam/dataframe/frames.py 94.87% <95.23%> (+<0.01%) ⬆️
sdks/python/apache_beam/io/textio.py 97.35% <100.00%> (+0.25%) ⬆️
...python/apache_beam/runners/worker/worker_status.py 78.26% <0.00%> (-1.45%) ⬇️
...runners/interactive/display/pcoll_visualization.py 86.36% <0.00%> (+0.50%) ⬆️
...pache_beam/runners/interactive/interactive_beam.py 76.58% <0.00%> (+0.97%) ⬆️
...hon/apache_beam/runners/direct/test_stream_impl.py 96.26% <0.00%> (+2.23%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 48318dd...a79d493. Read the comment docs.

@lostluck
Copy link
Contributor Author

lostluck commented Nov 3, 2021

Java failure is incredibly unrelated, merging.

@lostluck lostluck merged commit 82d94b3 into apache:master Nov 3, 2021
@ibzib
Copy link
Contributor

ibzib commented Nov 3, 2021

Java failure is incredibly unrelated, merging.

Thanks Rebo. What do you think about excluding release/src/main/scripts/ from Java/Python/etc. precommits? AFAIK these scripts are only intended to be run by humans during the release, so there's no point in triggering precommits for them.

@lostluck
Copy link
Contributor Author

lostluck commented Nov 3, 2021 via email

fernando-wizeline added a commit to fernando-wizeline/beam that referenced this pull request Nov 9, 2021
commit 6c954ca7106e67c0834b0e74926c376f02d5f811
Merge: e237c2fafb a1bfd088cc
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Tue Nov 9 10:45:26 2021 -0800

    Merge pull request #15868 from msbukal/PIPEWHEEL

    Minor HL7v2IO improvements

commit e237c2fafb28223e607ecd41a6d59b23dab43ad7
Author: Milena Bukal <msbukal@google.com>
Date:   Tue Nov 9 13:00:45 2021 -0500

    Improve FhirIO LRO Counters + minor fixes (#15921)

    * Improve LRO reporting

    Log the operation status, not just # of success/failures. Additionally added counters for this.

    * Increased polling time for operations

    Polling every 500ms is excessive, 15 seconds should be enough for expected time for an operation to complete.

    * Remove unsupported content structure for FHIR imports.

    FhirIO.Import specifically formats input JSON into NDJSON (even for
    pretty input) and then writes multiple resources to a single file.
    Therefore, only RESOURCE or BUNDLE content type can be specified. There
    is no functionality lost here, as pretty JSON can still be passed as
    input and will be transformed before the import operation begins.

    * Nit cleanups + missed increment.

    Increment counter for failure to start operations too (easy to miss this
    log and otherwise the job says it completed successfully).

commit 57e331bbb08d16b280cbf679be458e98a9b781a4
Author: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Tue Nov 9 20:48:02 2021 +0300

    Merge pull request #15804 from [BEAM-13109][Playground] Add processing of timeout for RunCode API method

    * [BEAM-13109][Playground]
    add timeout processing for processCode() method;
    add remote cache option to setupCache() method;

    * [BEAM-13109][Playground]
    fix tests after merge with master

    * [BEAM-13109][Playground]
    added new status: Status_STATUS_PREPARING
    added new status: Status_STATUS_PREPARATION_ERROR
    added preparation logic to processCode() method

    * [BEAM-13109][Playground]
    added TODO;
    renaming;

    * [BEAM-13109][Playground]
    regenerate pb files

commit 39bd3a4074316f31114e93bb489c85ffebb9a0dc
Merge: 7ebccbcea5 591f00ee8f
Author: Andrew Pilloud <apilloud@users.noreply.github.com>
Date:   Tue Nov 9 08:56:32 2021 -0800

    Merge pull request #15886: [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation

commit 7ebccbcea53d0b99edc043b72a557aa155b4742e
Author: Jack McCluskey <34928439+jrmccluskey@users.noreply.github.com>
Date:   Tue Nov 9 11:12:00 2021 -0500

    [BEAM-11097] Create hook to enable cross-bundle side input caching (#15896)

commit 591f00ee8fe60a2937456cd3ed0bf40702fdf402
Author: Andrew Pilloud <apilloud@google.com>
Date:   Wed Nov 3 14:33:18 2021 -0700

    [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation

commit 2f2e4fac9c9814ecba2e34d3700414fc4bc9c85d
Merge: cb1d5dec39 ea1bf40ef6
Author: Kyle Weaver <kcweaver@google.com>
Date:   Mon Nov 8 14:28:15 2021 -0800

    Merge pull request #15922 from ibzib/es-flake

    [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting fo…

commit ea1bf40ef61b77bfd6a4d0e73fab9ae147a70f69
Author: Etienne Chauchot <echauchot@apache.org>
Date:   Fri Sep 3 09:49:04 2021 +0200

    [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a fix because they are flaky.

commit cb1d5dec39306c1017832a1fca4ea0e288d841ae
Author: Aydar Farrakhov <stranniknm@gmail.com>
Date:   Mon Nov 8 23:46:00 2021 +0300

    Merge pull request #15813 from [BEAM-13071] [Playground] Update run code statuses and add notification system

    * [BEAM-13071]: add notification system

    * [BEAM-13071]: update run code statuses with new protobuf

    * [BEAM-13071] fix generated files

    * [BEAM-13071] fix generated files

    * [BEAM-13071] fix dart analysis

    * [BEAM-13071] remove duplicated run status cases

    * [BEAM-13071] fix licencess

commit f068a62e5498abf5e53945c992fd2a084ab14432
Merge: 5e44a133ce 24205850ef
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Mon Nov 8 12:44:18 2021 -0800

    Merge pull request #15879 from [BEAM-13155][Playground] Update the processing of error during run code

    [BEAM-13155][Playground] Update the processing of error during run code

commit 5e44a133ce69c95aa434536b73ae6f757c243cce
Author: Milena Bukal <msbukal@google.com>
Date:   Mon Nov 8 15:19:09 2021 -0500

    Merge pull request #15873 from [BEAM-13181] Remove Sharding from FhirIO.Import

    * Test FhirIO improvements

    * Remove batching from FhirIO.Import

    * Minor cleanup

    * Fix tmpGcsPath input

commit 84d57ca36294f1bc29d22a4ac4282a458999946c
Merge: 79496b2ff9 2a94534a3d
Author: Alexey Romanenko <33895511+aromanenko-dev@users.noreply.github.com>
Date:   Mon Nov 8 15:44:49 2021 +0100

    Merge pull request #15914: [BEAM-13157] add regression test for hadoop configuration on ParquetIO.Parse

commit 79496b2ff9f65c4584fa1a7a8e9630ffd6d16222
Merge: c04a2a8fef a9d9871512
Author: reuvenlax <relax@google.com>
Date:   Sat Nov 6 11:31:53 2021 -0700

    Merge pull request #15913: [BEAM-2791] remove spammy log statement

commit 2a94534a3d634c9c14f210bf24f02418157dad3f
Author: Michael Luckey <25622840+adude3141@users.noreply.github.com>
Date:   Sat Nov 6 17:41:24 2021 +0100

    [BEAM-13157] add regression test for hadoop configuration on ParquetIO.Parse

commit c04a2a8fef45a7852491988567fee62edfd25d0f
Merge: a3bb58dbd4 ba6aa4eb92
Author: Andrew Pilloud <apilloud@users.noreply.github.com>
Date:   Fri Nov 5 18:23:31 2021 -0700

    Merge pull request #15912: [BEAM-13080] Fix number of default keys in Reshuffle

commit ba6aa4eb92c6f8c7367b32ac47b920a68ce58aab
Author: InigoSJ <joseinigo@google.com>
Date:   Fri Nov 5 23:44:22 2021 +0000

    [BEAM-13080] Fix number of default keys

commit a9d9871512e3ea42c46bb5dada247403ef762db3
Author: Reuven Lax <relax@google.com>
Date:   Fri Nov 5 16:33:23 2021 -0700

    remove log statement

commit f2e660bd5095f93f5867f3781e8a16798677e378
Author: InigoSJ <joseinigo@google.com>
Date:   Fri Nov 5 22:13:33 2021 +0000

    [BEAM-13080] Fix number of default keys

commit a3bb58dbd4fc6a59f93f69f9ab1980f8232b6e82
Author: Robert Burke <lostluck@users.noreply.github.com>
Date:   Fri Nov 5 13:17:18 2021 -0700

    [Go SDK] Go SDK Exits Experimental (#15894)

commit e668460f61540638fb29e05997087b56ebcee4f3
Author: Ritesh Ghorse <riteshghorse@gmail.com>
Date:   Fri Nov 5 16:15:24 2021 -0400

    [BEAM-11217] Metrics Query filtering for DoFn metrics. (#15887)

commit f37b6c72c14bc19574d5cf403f11bf49648e4a54
Author: Moritz Mack <mmack@talend.com>
Date:   Fri Nov 5 18:02:05 2021 +0100

    [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910)

    * [BEAM] Fix buggy retry tests for AWS SnsIO

    * Fix interface

commit 56a4e5858b30027a3f9b477bb5889cd1933e72d9
Author: Benjamin Gonzalez <74670721+benWize@users.noreply.github.com>
Date:   Fri Nov 5 11:00:45 2021 -0600

    [BEAM-12566] Implement set_axis for DataFrame and Series (#15773)

    * [BEAM-12566] Initial implementation set_axis

    * [BEAM-12566] Implement set_axis for DataFrame and Series

    * [BEAM-12566] Reject set_axis(axis=index)

    * [BEAM-12566] Raise NotImplemented on Series.set_axis

commit 90a48ee4744c8766f812f4b673a4f1b295c4d8b7
Author: Moritz Mack <mmack@talend.com>
Date:   Fri Nov 5 15:15:43 2021 +0100

    [adhoc] Speedup slow tests for AWS IO modules (#15899)

    * [adhoc] Speedup slow tests for AWS IO modules

    * [adhoc] Speedup slow tests for AWS IO modules

    * Change EmbeddedSqsServer to use dynamic port to avoid competing for resources in tests

commit cb5913aa51243ed3fedc6030ad33bf2d52f52bc8
Author: Jiayang Wu <530081999@qq.com>
Date:   Thu Nov 4 13:51:43 2021 -0700

    [BEAM-13081] Fixes a compatible issue of decoding null-value bitmap between JVM coder and Python Coder (#15829)

    * tests passed

    * make one line shorter

    * reformat

    * reformat again

    * reformat for the last time

    Co-authored-by: Jiayang Wu <jiayangw@twitter.com>

commit 5e0030007fdcc1aa521c820c9b1f65384dacf454
Merge: 7497a2c466 e4f8f4b58b
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Thu Nov 4 11:51:47 2021 -0700

    [BEAM-3811] Code clean-up of the CancelleableQueue to not throw InterruptedException on cancel/reset since we are never stuck in a loop here or waiting on a signal.

commit 7497a2c4662a826b1e6a809bba3fbaf52f02fac7
Merge: fafe9d1db1 605485686b
Author: Chamikara Jayalath <chamikara@apache.org>
Date:   Thu Nov 4 10:22:18 2021 -0700

    Merge pull request #15891: [BEAM-13187] Set filesToStage after full jar resolution.

commit fafe9d1db1bc6d9e29bf33bd29dff5509dadc600
Author: reuvenlax <relax@google.com>
Date:   Thu Nov 4 09:58:51 2021 -0700

    Merge pull request #15810: [BEAM-2791] Support low-latency StorageApi sink with no exactly-once guarantees

commit 0b47f1b38dd612c1d0730a6dc6391d0438e6a84a
Author: Tomo Suzuki <suztomo@google.com>
Date:   Thu Nov 4 12:06:27 2021 -0400

    Merge pull request #15835: [BEAM-11205] Google Libraries BOM 24.0.0 and associated deps

    * Google Libraries BOM 24.0.0 and associated dependencies

    * The example Java test to declare bigquery dependency

    * ApiSurface test to skip non-public annotations

    * Added Libraries BOM upgrade into the 2.35.0 changelog

commit f4888029d13f8a0691b4a3b118045e6f3f36d0dd
Merge: 164a4587d1 963cf92c9f
Author: Heejong Lee <heejong@gmail.com>
Date:   Thu Nov 4 08:59:19 2021 -0700

    Merge pull request #15692 from ihji/BEAM-13021

    [BEAM-13021] Deduplicate Python artifact not only by hash but also by source path.

commit 164a4587d120902e9b330035feaf1de61c31861f
Merge: 0262dd6a54 1e388f9733
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Thu Nov 4 07:38:56 2021 -0700

    [BEAM-13164] Address most of a race condition between instantiation and usage of member variables.

commit 0262dd6a5434ffc60c9ea73e700aeb4dad62ff3e
Merge: 0faa3b9403 f829123af1
Author: Alexey Romanenko <33895511+aromanenko-dev@users.noreply.github.com>
Date:   Thu Nov 4 13:20:01 2021 +0100

    Merge pull request #15841: [BEAM-11440] Add integration test for KinesisIO using Localstack (aws2)

commit 963cf92c9f4572b8ac714ab07fd539a324ee3c57
Author: Heejong Lee <heejong@gmail.com>
Date:   Wed Nov 3 18:34:40 2021 -0700

    s/pathes/paths/

commit 605485686b67e1ddfd3a471e091a55ae33fa03c9
Author: Robert Bradshaw <robertwb@gmail.com>
Date:   Wed Nov 3 17:22:54 2021 -0700

    Defer filesToStage construction until after full jar resolution.

commit 0faa3b9403bd9c852075f2baf9b2e1f9d588677f
Merge: c79eaf849e 013da5568a
Author: Kyle Weaver <kcweaver@google.com>
Date:   Wed Nov 3 16:32:21 2021 -0700

    Merge pull request #15885 from ibzib/wc-twister2

    Fix typo: s/spark/twister2

commit c79eaf849ec7764f48c9d4c9012cb1824ab8ec56
Merge: bee60cdc29 3c3bfa36eb
Author: Robert Bradshaw <robertwb@google.com>
Date:   Wed Nov 3 15:48:05 2021 -0700

    Merge pull request #15630 Fix Python test example in documentation

commit 1e388f9733237746c3cc715495075460aa240e96
Author: Luke Cwik <lcwik@google.com>
Date:   Wed Nov 3 15:32:30 2021 -0700

    [BEAM-13164] Address most of a race condition between instantiation and usage of member variables.

    There is a race condition being observed where we are passing the `InboundObserver` to the `outboundObserverFactory` here (https://github.com/apache/beam/blob/bee60cdc29d995170d4461692e391683ca7dcafd/sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/BeamFnDataGrpcMultiplexer2.java#L68). This allows for incoming calls to start before the BeamFnDataGrpcMultiplexer2 is fully initialized meaning that the erroredInstructionIds is accessed before it is initialized.

    This seems like a general problem with how we connect the inbound and the outbound observer (because of the ClientCallStreamObserver callack that is necessary) that only happens on the SDK harness since there is no need to connect the inbound and outbound observers this way on the ServerCallStreamObserver.

commit 013da5568a64e46204a33e58cc2233eae7e0c577
Author: Kyle Weaver <kcweaver@google.com>
Date:   Wed Nov 3 15:21:13 2021 -0700

    Fix typo: s/spark/twister2

commit bee60cdc29d995170d4461692e391683ca7dcafd
Merge: 156bfc2dd7 2cfb6a71b2
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Wed Nov 3 14:27:20 2021 -0700

    Merge pull request #15862 from [BEAM-13165] JdbcIO has a single WriteFn underlying all implementations

    [BEAM-13165] JdbcIO has a single WriteFn underlying all implementations

commit 156bfc2dd7df9541205475d1e3b483ca012db2ac
Author: Aydar Farrakhov <stranniknm@gmail.com>
Date:   Wed Nov 3 23:55:54 2021 +0300

    Merge pull request #15852 from [BEAM-13102] [Playground] update playground according with the latest design changes

    * [BEAM-13102] update playground according to the last design changes

    * [BEAM-13102] fix license

    * [BEAM-13102] fix licencse

    * [BEAM-13102] add licences to svg files

    * [BEAM-13102] add licences to svg files

commit 219bca3ca05c8c18cd345d31f713b7d93de55254
Author: Heejong Lee <heejong@gmail.com>
Date:   Wed Nov 3 12:51:32 2021 -0700

    rearrange comparison order

commit 82d94b3a98543212922c8dae6eb9ba9072e34976
Author: Robert Burke <lostluck@users.noreply.github.com>
Date:   Wed Nov 3 12:47:36 2021 -0700

    [BEAM-13119] Subdirectory prefix tag for Go SDK (#15881)

commit 0d2b05b646025b1b6f30f205ec49f209e79c9024
Merge: 95e9de7891 d5cd15ab4d
Author: Michael Luckey <25622840+adude3141@users.noreply.github.com>
Date:   Wed Nov 3 20:39:43 2021 +0100

    Merge pull request #15856: [BEAM-13157] support hadoop configuration on ParquetIO.Parse

commit 95e9de7891593fa73d582cb6ba5ac0333b2675ff
Author: Fernando Morales <80284146+fernando-wizeline@users.noreply.github.com>
Date:   Wed Nov 3 12:31:23 2021 -0700

    Merge pull request #15784 from [BEAM-8135]  - Removing BigQueryResultsPublisher and its references

    * Removing BigQueryResultsPublisher and its references

    * Removing bigquerypublisher code from Groovy tests

    * Removing remaining bigquery references

    * Applying spotless

commit 4f3b5c0f0625b02ef25311afc11df2babd1a155d
Author: Jack McCluskey <34928439+jrmccluskey@users.noreply.github.com>
Date:   Wed Nov 3 15:18:12 2021 -0400

    Add window mapping to CHANGES.md (#15871)

commit 0f94f961709f6d728bcc950d5966601a4c5bb6b9
Author: Ritesh Ghorse <riteshghorse@gmail.com>
Date:   Wed Nov 3 15:16:51 2021 -0400

    [BEAM-13001] updated CHANGES.md to include msec counter for Go (#15872)

commit 069095300fbbb0f98e9e9b732e84d7d572101a17
Author: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Wed Nov 3 22:11:14 2021 +0300

    Merge pull request #15839 from [BEAM-13041][Playground] Prepare files with java code

    * [BEAM-13041][Playground]
    Add Prepare step as one of the executor's steps;
    Add Java preparation methods to remove "package ..." string from file;
    Add Java preparation methods to change "public class" strings to "class" string into file;

    * [BEAM-13041][Playground]
    minor fix

    * [BEAM-13041][Playground]
    add using of logger;
    change the package pattern;

commit 4af1e52809be122d40e03eb0fb7925db6feec145
Merge: beac28dbdd f41cdf40fa
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Wed Nov 3 12:03:14 2021 -0700

    [BEAM-13015] Use a network based channel instead of an inmemory one which allows us to more faithfully mirror performance/overhead of the SDK harness.

commit beac28dbdd602e11b1a2ab2f1474abb9655c3f4c
Merge: 735db247f3 0d172c3e54
Author: Udi Meiri <udim@users.noreply.github.com>
Date:   Wed Nov 3 11:56:34 2021 -0700

    Merge pull request #15880: Performance improvement to PubSubLiteIO to not use a streaming committer to send one commit message

commit 2cfb6a71b234c9c56c0aa4b8dedf066d23c9a566
Author: Pablo Estrada <pabloem@apache.org>
Date:   Wed Nov 3 11:34:45 2021 -0700

    Addressing comments

commit 735db247f3e03d9fddb9f6d7281c986b60ac683d
Merge: 07aaec344a 6a63eb9932
Author: Ning Kang <kawaigin@gmail.com>
Date:   Wed Nov 3 11:05:23 2021 -0700

    [BEAM-13140] Fixes bug in WriteRename class

commit f41cdf40fa44aec6d460bddff5afd168ada1fa40
Author: Luke Cwik <lcwik@google.com>
Date:   Wed Nov 3 10:34:29 2021 -0700

    [BEAM-13015] Use a network based channel instead of an inmemory one which allows us to more faithfully mirror performance/overhead of the SDK harness.

commit 07aaec344aef38ac7034e65c909ed75893a9d48d
Author: Brian Hulette <bhulette@google.com>
Date:   Wed Nov 3 10:17:39 2021 -0700

    [BEAM-13099] Use vendored Calcite 1.28.0 in SQL extensions (#15836)

    * [BEAM-13099] Drop vendor:calcite-1_26_0

    * [BEAM-13099] update library to vendored-calcite-1_28_0

    * [BEAM-13099] s/org.apache.beam.vendor.calcite.v1_26_0/org.apache.beam.vendor.calcite.v1_28_0/

    * [BEAM-13099] org.apache.beam.vendor.calcite.{v1_26_0->v1_28_0}.org.codehaus.commons.compiler.properties

    * [BEAM-13099] Adjust test cases for 1.28.0 changes

    * [BEAM-13099] Fix AggregateCall.create call for https://github.com/apache/calcite/commit/f1da65504e598928cf77aa6a7244552692ae2529

    * [BEAM-13099] Add 'provided' dependency for calcite's immutable annotations

    * [BEAM-13099] Fix checkerframework errors due to new Nullable annotations in Calcite

commit 6a63eb9932824bc723a59804343924f8e2ff3ce1
Author: Hector Lagos <hlagosperez@twitter.com>
Date:   Thu Oct 28 12:33:52 2021 -0400

    Use BigQuieryIO.loadProjectId  in WriteRename class to create JobRefernce config and Fix side input for WriteRename

commit 24205850efc35caff49f8adbbf04f79e625b575c
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Wed Nov 3 18:56:24 2021 +0300

    [BEAM-13155][Playground]
    add a new status: STATUS_RUN_ERROR;
    add a new API method GetRunError;
    add a new sunKey RunError;
    update of validation processing;

commit 48318dd3aedeb208648149eca36165bbfff09e1a
Author: Aydar Farrakhov <stranniknm@gmail.com>
Date:   Wed Nov 3 18:48:51 2021 +0300

    Merge pull request #15782 from [BEAM-13034] [Playground] add semantics to playground app

    * [BEAM-13034]: add semantics to playground app

    * [BEAM-13034]: add semantics to playground app

    * [BEAM-13034]: add lang attribute to improve acceesibility

    * [BEAM-13034] fix dart analysis

commit 9bca51f8e808b660b77ee0e96b9ae0eaa6a20967
Author: Svetak Sundhar <svetaksundhar@google.com>
Date:   Wed Nov 3 11:45:33 2021 -0400

    [BEAM-12550] Parallelizable skew Implementation  (#15809)

    * [BEAM-12550] Implement Parallelizable Skew and Kurtosis
    (Skew implementation)

    R: @TheNeuralBit

    * [BEAM-12550] Implement Parallelizable Skew and Kurtosis
    (Skew implementation)

    R: @TheNeuralBit

    * [BEAM-12550] Implement Parallelizable Skew and Kurtosis
    (Skew implementation)

    R: @TheNeuralBit

    * [BEAM-12550] Implement Parallelizable Skew and Kurtosis
    (Kurtosis implementation)

    * [BEAM-12550] Implement Parallelizable Skew and Kurtosis
    (Kurtosis implementation)

    * [BEAM-12550] Implement Parallelizable Skew and Kurtosis
    (Kurtosis implementation)

    * [BEAM-12550] Implement Parallelizable Skew and Kurtosis
    (Skew implementation)

    Co-authored-by: svetakvsundhar <svetak.sundhar@gmail.com>

commit 9109354e3d6aefecc8b1a41004347ae9962329ab
Author: daria.malkova <daria.malkova@akvelon.com>
Date:   Wed Nov 3 18:36:48 2021 +0300

    Merge pull request #15854 from [BEAM-13046][Playground] protobuf supporting examples API

    * Change protobuf

    * Regenerate protobuf files with "buf" gradle task

    * Add todo's to controller

    * Proto files

    * Add License to generated proto files

    * Change the structure of the list of example

    * Merge, fix precommit task, add licenses

commit 7db9d2c8b54df0987e233e1a777b285e64e20b93
Merge: 92ba229336 b97a1c3698
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Wed Nov 3 08:34:47 2021 -0700

    Merge pull request #15814 from [BEAM-13105] [Playground] - add shortcut hint tooltip

    [BEAM-13105] [Playground] - add shortcut hint tooltip

commit 0d172c3e54d7c773671a6484965d6daa442fec15
Author: Daniel Collins <dpcollins@google.com>
Date:   Wed Nov 3 11:21:06 2021 -0400

    Performance improvement to PubSubLiteIO to not use a streaming committer to send one commit message.

commit 92ba229336aa9cc4132f498d7049ecf67bc1c3b3
Merge: 2d80f93b7b 8830745867
Author: tvalentyn <tvalentyn@users.noreply.github.com>
Date:   Tue Nov 2 15:33:32 2021 -0700

    [BEAM-12730] Handle corner case for TextIO with custom delimiter  #15864

commit a1bfd088cc26c0c9576072c6698447c12b397248
Merge: c4feaff74b 2d80f93b7b
Author: Milena Bukal <msbukal@google.com>
Date:   Tue Nov 2 16:58:51 2021 -0400

    Merge branch 'apache:master' into PIPEWHEEL

commit 2d80f93b7bce4bc42498dc845e9e411641b9cd90
Merge: a2885d57dc 8cdc527407
Author: Andrew Pilloud <apilloud@users.noreply.github.com>
Date:   Tue Nov 2 12:17:29 2021 -0700

    Merge pull request #15846: [BEAM-13118] Use branch for nightly "tag", tags are immutable

commit a2885d57dc30788b272759d39e738c0870ea7d17
Author: Brian Hulette <bhulette@google.com>
Date:   Tue Nov 2 11:52:44 2021 -0700

    Minor: add resource key to presentation materials link (#15867)

commit 5ca2647670bd99cfe95537ada8a82b4bf5f6871c
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Tue Nov 2 11:13:09 2021 -0700

    Merge pull request #15832 from [BEAM-13149] Changing readWithPartitions to work with longs. Removing untested (non-working) code path

    * Changing readWithPartitions to work with longs. Removing untested (non-working) code path

    * Address comments

commit 526359b27e61463c5b9b2fa86d9ba23ed5890f3e
Author: Pavel Avilov <avilovpavel6@gmail.com>
Date:   Tue Nov 2 20:42:24 2021 +0300

    Merge pull request #15838 from [BEAM-13127] [Playground] Implement TCP listener

    * Implement TCP listener

    * Using our own logger

    Co-authored-by: Pavel Avilov <pavel.avilov>

commit 8162fb3c8e7162fb413a3150aef4d83433dbabb6
Author: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Tue Nov 2 20:36:23 2021 +0300

    Merge pull request #15842 from [BEAM-13125][Playground] Update documentation for environments

    * [BEAM-13125][Playground]
    add comments for all environments files

    * [BEAM-13125][Playground]
    update comments

    * [BEAM-13125][Playground]
    update comments

commit c4feaff74b093152cea2dc2523f85a2dd79d5dd7
Author: Milena Bukal <msbukal@google.com>
Date:   Tue Nov 2 13:24:31 2021 -0400

    Minor HL7v2IO Fixes

    - Fix comments, HL7v2 import is supported & in GA, but not supported by
    the HL7v2IO.
    - Fix unused counter.

commit 49d828a9915a858ddc9dd87049ec477601db0ed5
Author: Ritesh Ghorse <riteshghorse@gmail.com>
Date:   Tue Nov 2 12:11:42 2021 -0400

    [BEAM-13001] fixes nil reference error in Extractor.ExtractFrom (#15865)

commit 26545025233f3cbf9430350a432e2bedeaeaad50
Merge: 59bd9a0fc9 0bb6c1494f
Author: Alexey Romanenko <33895511+aromanenko-dev@users.noreply.github.com>
Date:   Tue Nov 2 14:57:10 2021 +0100

    Merge pull request #15811: [BEAM-12070] Make ParquetIO splittable by default

commit 0bb6c1494fa4cfbb4dfce8a27bc575adb4be1b4d
Author: Alexey Romanenko <aromanenko.dev@gmail.com>
Date:   Fri Oct 29 15:17:29 2021 +0200

    [BEAM-12070] ParquetIO: use splittable reading by default

commit 8830745867f7c86d18c24595eb75cf89afe15d20
Author: Dmitrii_Kuzin <dmitrii_kuzin@epam.com>
Date:   Tue Nov 2 12:03:26 2021 +0300

    [BEAM-12730] Python. Custom delimiter add corner case

commit 59bd9a0fc92fd4b9b8bd611a6a3845dc44fec321
Merge: 5103b8f760 59f57728a8
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Mon Nov 1 20:32:20 2021 -0700

    Merge pull request #15853 from [BEAM-13145][Playground] Validation error

    [BEAM-13145][Playground] Validation error

commit 5103b8f76030e26c491b145a92bacf2e04897c13
Author: Ilya <ilya.kozyrev@akvelon.com>
Date:   Tue Nov 2 03:43:07 2021 +0300

    Merge pull request #15840 from [Playground][BEAM-13146][Bugfix] playgroundPreCommit work incorrectly for frontend if flutter dependencies isn't installed

    * fix order for analyze task, starts after pubGet

    * add dependsOn instead of mustRunAfter
    Co-authored-by: damondouglas

commit eb297f4883b422f4f56572c6b433e4f14b95e810
Merge: a17cd065ba 7c6c43f2e2
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Mon Nov 1 17:41:23 2021 -0700

    Merge pull request #15855 from [BEAM-13128] [Playground] Cleaning up environment variables in environment_service_test

    [BEAM-13128] [Playground] Cleaning up environment variables in environment_service_test

commit 66ef31671d3cfbd19147efabf6ec97e606b4239a
Author: Pablo Estrada <pabloem@apache.org>
Date:   Mon Nov 1 17:17:26 2021 -0700

    JdbcIO has a single WriteFn underlying all implementations

commit a17cd065bae25fb6742e60c4b0419b7262405157
Author: Ritesh Ghorse <riteshghorse@gmail.com>
Date:   Mon Nov 1 19:38:14 2021 -0400

    [BEAM-13001] fixes Golint issues (#15859)

commit e4f8f4b58b2b07be179cb5ca47a9281f01380861
Author: Luke Cwik <lcwik@google.com>
Date:   Fri Oct 29 17:42:37 2021 -0700

    [BEAM-3811] Code clean-up of the CancelleableQueue to not throw InterruptedException on cancel/reset since we are never stuck in a loop here or waiting on a signal.

    Also update one location simplifying the queue interaction semantics to have the StreamObserver only interacted from the queue draining thread instead of relying on synchronization.

commit a4e112974d8f3f51e646d9e714a4f8d456d69b4d
Author: Benjamin Gonzalez <74670721+benWize@users.noreply.github.com>
Date:   Mon Nov 1 10:53:24 2021 -0600

    [BEAM-11936] Fix errorprone warnings (#15821)

    * [BEAM-11936] Fix errorprone warnings: AssignmentToMock, AnnotateFormatMethod, BadImport

    * [BEAM-11936] Fix spotlessApply, fix errorprone warnings

    * [BEAM-11936] Fix dependency errors, add supresswarning

    * [BEAM-11936] Fix dependency errors, add supresswarning

    * [BEAM-11936] Fix dependency errors, add supresswarning

    * [BEAM-11936] Fix errorprone warning JodaPlusMinusLong

    * [BEAM-11936] Fix errorprone warning: CompareToZero

    * [BEAM-11936] Fix errorprone warning: SameNameButDifferent

    * [BEAM-11936] Fix errorprone warning: UnnecessaryAnonymousClass

    * [BEAM-11936] Fix spotlessApply, remove leftover code

    * [BEAM-11936] Fix errorprone warning: SameNameButDifferent supressed

commit d5cd15ab4debbef0d967226bcebf2facc4d3e071
Author: Michael Luckey <25622840+adude3141@users.noreply.github.com>
Date:   Mon Nov 1 17:03:12 2021 +0100

    [BEAM-13157] support hadoop configuration on ParquetIO.Parse

commit 7c6c43f2e2b0ebd899c9cd1f237b1498bd88bcc9
Author: Pavel Avilov <avilovpavel6@gmail.com>
Date:   Mon Nov 1 18:16:22 2021 +0300

    Added cleanup os env before and after tests

commit 59f57728a8ba5f1490d2f4f6aa35bb0c317240c6
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Mon Nov 1 16:27:31 2021 +0300

    [BEAM-13145][Playground]
    add a new status: STATUS_VALIDATING;
    add a new status: STATUS_VALIDATION_ERROR;
    add a new status: STATUS_COMPILING;
    update of validation processing;

commit b97a1c3698728f4389d6fa6c35c7b3768001567a
Merge: 2c3e9799f7 08e0998e12
Author: Aydar Farrakhov <stranniknm@gmail.com>
Date:   Mon Nov 1 10:13:31 2021 +0300

    Merge branch 'master' into BEAM-13105

    # Conflicts:
    #	playground/frontend/lib/modules/actions/components/new_example_action.dart

commit 08e0998e12dda1b7754b2b05fcdcca5038295463
Author: Iñigo San Jose Visiers <42574310+InigoSJ@users.noreply.github.com>
Date:   Sat Oct 30 22:09:09 2021 +0100

    Merge pull request #15753 from [BEAM-13080] Add option in Reshuffle to set num of keys generated.

    * [BEAM-13080] Add option in Reshuffle to set num of keys generated.

    * [BEAM-13080] Add option in Reshuffle to set num of keys generated.

    * [BEAM-13080] Add option in Reshuffle to set num of keys generated.

    * [BEAM-13080] Add option in Reshuffle to set num of keys generated.

commit a5a0bd26ded0117240b2f6a967eb9f4c65209e6c
Merge: cb9fb5110a 3fe3e1545f
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Fri Oct 29 14:25:12 2021 -0700

    [BEAM-13015] Migrate bundle processing in the SDK harness to using BeamFnDataInboundObserver2 and BeamFnDataGrpcMultiplexer2.

commit cb9fb5110aea50c3cbc2d7b49191b32d38a0307b
Merge: d8cecb1475 ab2ddaa1bf
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Fri Oct 29 14:14:08 2021 -0700

    [BEAM-13099] Add build files for vendored Calcite 1.28.0

commit d8cecb14750dc0baf475bee40a591cf1b1f5b1cb
Author: Ritesh Ghorse <riteshghorse@gmail.com>
Date:   Fri Oct 29 15:54:58 2021 -0400

    [BEAM-13001] DoFn metrics for Go SDK (#15657)

commit 8cdc5274078f3242105801be43d6a202082a1054
Author: Andrew Pilloud <apilloud@google.com>
Date:   Fri Oct 29 11:25:01 2021 -0700

    [BEAM-13118] Use branch for nightly "tag", tags are immutable

commit 2e448dee58f1ee60551cc47b9aa7df6bc832734a
Author: Chamikara Jayalath <chamikara@apache.org>
Date:   Fri Oct 29 09:59:34 2021 -0700

    [BEAM-12047] Updates CHANGES.md to mention the URN convention (#15845)

    * Updates CHANGES.md to mention the URN convention

    * Updated text

commit f048874b6d7b224058a712e6a21b1e5151c3bc39
Author: Brian Hulette <bhulette@google.com>
Date:   Fri Oct 29 09:32:09 2021 -0700

    Minor: Remove broken python compatibility checks (#15828)

commit 5ce06db5cdc402c8af4acdd9c9cbebfaa65f4d88
Author: Brian Hulette <bhulette@google.com>
Date:   Fri Oct 29 09:00:55 2021 -0700

    [BEAM-13099] Use BlockBuilder.add(..) rather than BlockBuilder.append(Expressions.block(..)) (#15837)

commit ab2ddaa1bf5804f35dfd01ae6712f0388209afc5
Author: Brian Hulette <bhulette@google.com>
Date:   Thu Oct 21 14:04:04 2021 -0700

    [BEAM-13099] Modifications for vendor/calcite-1_28_0 build

commit 8382982972dc59432778e85a4e6ec5808009e637
Author: Brian Hulette <bhulette@google.com>
Date:   Fri Oct 29 08:47:07 2021 -0700

    [BEAM-13099] Copy vendored calcite build for 1.28.0

commit 67ef9aca13c274fab4179e1a553c77e2afc6d683
Author: Moritz Mack <mmack@talend.com>
Date:   Fri Oct 29 17:17:59 2021 +0200

    [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider (kinesis v1) (#15816)

    * [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider (kinesis module using SDK v1)

    * fix comment

    * Address nullability issues

    * Commit missing test for AwsModule

    * Format AwsModuleTest

commit f829123af1c26e2ebf9d33af580c64d909ec94c6
Author: mosche <mmack@talend.com>
Date:   Fri Oct 29 13:44:51 2021 +0200

    Use vendored guava deps

commit aa67b0f8b5b90da86357b129aedfecc7c0e5df73
Author: mosche <mmack@talend.com>
Date:   Fri Oct 29 12:41:42 2021 +0200

    Apply format

commit b60f73215c2c68c5db14c034008b50a1bd064f5c
Author: mosche <mmack@talend.com>
Date:   Fri Oct 29 12:29:11 2021 +0200

    Apply format

commit 0831b758042c4c86bef28e54710a9bebec9287a0
Author: mosche <mmack@talend.com>
Date:   Fri Oct 29 12:16:09 2021 +0200

    Bump localstack container version for DynamoDBIOTest to version used in KinesisIOIT

commit aa5f06f7029b0bf0615893c76f80145ac943c608
Author: mosche <mmack@talend.com>
Date:   Fri Oct 29 12:15:05 2021 +0200

    Bump localstack container version for more robust version with respect to HTTP/HTTPS and simplify KinesisIOIT in kinesis module.

commit ec99053d66bb764f9bd67236c9f4651ad4a89add
Author: mosche <mmack@talend.com>
Date:   Fri Oct 29 12:13:10 2021 +0200

    [BEAM-11440] Add integration test for KinesisIO using Localstack on javaPostCommit

commit 643825bc956df0e8fa9e6d10b2f10f317f4afb55
Merge: d07c52809c 8e0e23029e
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Thu Oct 28 21:59:25 2021 -0700

    Merge pull request #15801 from [BEAM-12970][Playground] Implement gRPC API - GetCompileOutput

    [BEAM-12970][Playground] Implement gRPC API - GetCompileOutput

commit d07c52809c5278ad0931555c42203976e3294cdc
Author: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Fri Oct 29 07:59:10 2021 +0300

    Merge pull request #15800 from [BEAM-12970][Playground] Implement gRPC API - CheckStatus

    implement CheckStatus API method

commit ce32c82740bf8a395feb90498338ddbd61c7c120
Author: Artur Khanin <artur.khanin@akvelon.com>
Date:   Fri Oct 29 07:58:18 2021 +0300

    Merge pull request #15802 from [BEAM-12970][Playground] Implement gRPC API - GetRunOutput

    * Implemented GetRunOutput and covered with unit tests

    * Replaced logging library regarding PR comment

commit 06d22077c904400502e3257a54fb6bfbd620dc33
Merge: 837e11c5b7 fd2d445ed4
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Thu Oct 28 21:52:50 2021 -0700

    Merge pull request #15824 from [BEAM-13120][Playground] GetSdkEnvsFromOsEnvs should check APP_WORK_DIR env before extracting

    [BEAM-13120][Playground] GetSdkEnvsFromOsEnvs should check APP_WORK_DIR env before extracting

commit 837e11c5b75a46269e5562cd711bbf17757c1da9
Author: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Fri Oct 29 07:47:00 2021 +0300

    Merge pull request #15721 from [BEAM-13023][Playground] Implement Redis cache for pipelines' states

    * Implement local cache for pipelines' states

    * [BEAM-13005][Playground]
    add context;
    add redis option to NewCache;

    * [BEAM-13023][Playground]
    Add Redis implementation of Cache

    * [BEAM-13023][Playground]
    moved the code inside the methods from the individual methods;
    change RedisCache according to extends-like pattern;
    change grpclog to log

    * [BEAM-13023][Playground]
    add tests

    * [BEAM_13023][Playground]
    update go.sum

    * Edit GetValue method

    * [BEAM-13023][Playground]
    update go.sum

    * [BEAM-13023][Playground]
    add comments for cache.go;
    rename NewCache method to New

    * [BEAM-13023][Playground]
    remove constructor from cache.go
    rename constructor method from newLocalCache to New
    rename constructor method from newRedisCache to New
    move localCache files to new folder (local)
    move redisCache files to new folder (redis)

    * [BEAM-13023][Playground]
    Update regarding new place for generated files

    * [BEAM-13005][Playground]
    remove constructor from cache.go;
    rename constructor method from newLocalCache to New;
    move localCache files to new folder (local);
    add comments;

    * Resolve comments

    * [BEAM-13023][Playground]
    remove default expiration time;
    rename RedisCache to Cache

    * [BEAM-13023][Playground]
    update go.sum

    * [BEAM-13023][Playground]
    update go.sum

    * [BEAM-13023][Playground]
    add using logger

    Co-authored-by: Pavel Avilov <avilovpavel6@gmail.com>
    Co-authored-by: Ilya Kozyrev <ilya.kozyrev@akvelon.com>

commit b06188653ccf2ac0315438ee0bc316e1cfa4500d
Merge: 15682b40b6 552cca7ecc
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Thu Oct 28 21:04:19 2021 -0700

    Merge pull request #15831 from [BEAM-13144] Handle runner-provided shards for TextIO

    [BEAM-13144] Handle runner-provided shards for TextIO

commit 15682b40b6fabfea4128e7a9fc6ffdd34ba0e8a1
Merge: cd4b7f3b1a 2a6c80b4eb
Author: tvalentyn <tvalentyn@users.noreply.github.com>
Date:   Thu Oct 28 20:04:51 2021 -0700

     [BEAM-13143] Fix python doc generator error. #15830

commit 552cca7ecc05bd65585af748af8fefb689d148b8
Author: Pablo Estrada <pabloem@apache.org>
Date:   Thu Oct 28 15:38:44 2021 -0700

    Handle runner-provided shards for TextIO

commit 2a6c80b4eb69fc6e4fb0d9cf7e421c5b06172918
Author: Kyle Weaver <kcweaver@google.com>
Date:   Thu Oct 28 15:09:06 2021 -0700

    [BEAM-13143] Fix python doc generator error.

commit cd4b7f3b1af4f51bdab1a0b1a98f94b5288c09ec
Merge: 4cdbe8dc3a 60eaa8256d
Author: Brian Hulette <bhulette@google.com>
Date:   Thu Oct 28 11:06:07 2021 -0700

    [BEAM-13099] Use RelMetadataQuery subclass rather than calling RelNode.metadata (#15820)

    [BEAM-13099] Use RelMetadataQuery subclass rather than calling RelNode.metadata

commit 60eaa8256d2d6451d6defe1eaca783721c5a07f5
Author: Brian Hulette <bhulette@google.com>
Date:   Wed Oct 27 16:40:04 2021 -0700

    [BEAM-13099] Update all rels to use BeamRelMetadataQuery

commit 0e5451fc380365db9b738d22aae74e2a22d04154
Author: Brian Hulette <bhulette@google.com>
Date:   Wed Oct 27 16:39:41 2021 -0700

    [BEAM-13099] Replace call to RelNode.metadata with BeamRelMetadataQuery

commit 4cdbe8dc3a4be8fd3e6ee74cef43af3fb03761b1
Author: Jack McCluskey <34928439+jrmccluskey@users.noreply.github.com>
Date:   Thu Oct 28 13:14:23 2021 -0400

    [BEAM-13130] Remove persistent references to stateKeyReaders (#15815)

commit 290d9947af13477df6f08a9340f8eb30feac40a6
Merge: e8924960f3 af925d8520
Author: Alexey Romanenko <33895511+aromanenko-dev@users.noreply.github.com>
Date:   Thu Oct 28 19:13:41 2021 +0200

    Merge pull request #15823: [BEAM-13138] Update code to retrieve container endpoint in DynamoDBIOTest (aws2)

commit e8924960f3feb79ac7fd5403d1bfde4908598b7b
Author: Miguel Hernandez <61989986+roger-mike@users.noreply.github.com>
Date:   Thu Oct 28 11:00:27 2021 -0500

    Merge pull request #15294 from [BEAM-11986] Spanner write metric

    * [BEAM-11986] Spanner write metric

    * [BEAM-11986] Spanner read metric

    * [BEAM-11986] SpannerIO metrics integration tests

    * [BEAM-11986] SpannerIO metrics helper functions

    * [BEAM-11986] ServiceCallMetric instantiated before API call

    * [BEAM-11986] Skipped metrics tests on Dataflow

commit d9d61311179a2a83ebcd5994d2a15fcdb5b93164
Merge: ec1decd21a ed8bba5639
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Thu Oct 28 08:57:40 2021 -0700

    Merge pull request #15822 from [BEAM-13126][Playground][Bugfix] Fix executor builder tests

    [BEAM-13126][Playground][Bugfix] Fix executor builder tests

commit ec1decd21a3001a382e9b5ba0d220e62ac3b5ded
Author: Alexandr Zhuravlev <stimbai@mail.ru>
Date:   Thu Oct 28 18:56:29 2021 +0300

    Merge pull request #15709 from [BEAM-12967] [Playground] Create Example Selector initital structure

    * [BEAM-12967]: Created Examples Component

    * [BEAM-12967]: Wrapped CategoryBubble and ExpansionPanelItem in MouseRegion

    * [BEAM-12967] Added generated files

    * [BEAM-12967]: Added license to generated files

    * [BEAM-12967]: Deleted duplicate files

    * [BEAM-12967]: Formatted files

commit fd2d445ed451be894901140bcf7e41ffb1cde125
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Thu Oct 28 16:57:01 2021 +0300

    [BEAM-13120][Playground]
    add working dir for setting up sdk environment;
    renaming;

commit af925d8520ca0542755bd4553bad7f771f9148d3
Author: mosche <mmack@talend.com>
Date:   Thu Oct 28 15:18:53 2021 +0200

    [BEAM-13138] Update code to retrieve container endpoint

commit ed8bba563992b1e02a5e10279627a211200e0f6e
Author: daria-malkova <daria.malkova@akvelon.com>
Date:   Thu Oct 28 12:44:18 2021 +0300

    fix executor tests

commit 8e0e23029e4cf405831091c334d368ece333a302
Author: Artur Khanin <artur.khanin@akvelon.com>
Date:   Thu Oct 28 10:59:21 2021 +0300

    Replaced logging library regarding PR comment

commit 02062eae4231ad25d55cfc158d0b3c4ffc2715d6
Author: Artur Khanin <artur.khanin@akvelon.com>
Date:   Tue Oct 26 16:29:09 2021 +0300

    Implemented GetCompileOutput and covered with unit tests

commit fbd0330679f50c0909bfa3b7c8db32dc4771e446
Merge: abf7ce29c3 9849940576
Author: tvalentyn <tvalentyn@users.noreply.github.com>
Date:   Wed Oct 27 23:27:57 2021 -0700

    Fix Python docs build pre-commit failures. #15812

commit abf7ce29c35460f9a3f8920d09020f8416066c35
Merge: 7b0de72a84 fb990f28e7
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Wed Oct 27 22:45:10 2021 -0700

    Merge pull request #15803 from [BEAM-12970][Playground] Implement gRPC API - RunCode

    [BEAM-12970][Playground] Implement gRPC API - RunCode

commit fb990f28e7c95300481bd6ccf42c089f8c9cb214
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Thu Oct 28 08:29:53 2021 +0300

    [BEAM-12970][Playground]
    add comments for tests;
    add TODO for finding java executable name;

commit 7b0de72a84298f19365d3a2166822105d534c92b
Author: Robert Bradshaw <robertwb@google.com>
Date:   Wed Oct 27 13:30:48 2021 -0700

    [BEAM-13066] Disable using abstract iterable by default. (#15805)

commit fa69c710ccc7195e5ffca7d7b5b50b5af27b22b4
Author: Robert Bradshaw <robertwb@google.com>
Date:   Wed Oct 27 13:30:02 2021 -0700

    [BEAM-13066, BEAM-13087] Workaround for coder type combiner packing iterable issue on legacy dataflow runner (#15757)

commit f8d3c1bed4a8b1f500fad61001cfa24d2da6afc3
Author: reuvenlax <relax@google.com>
Date:   Wed Oct 27 10:17:26 2021 -0700

    Merge pull request #15731: [BEAM-13067]  Mark GroupIntoBatches output as preserving keys

commit 3fcc5843f5b2045f2e3caa3f761ff3d23daa0760
Merge: 86d429a803 e6fc61e6af
Author: reuvenlax <relax@google.com>
Date:   Wed Oct 27 10:16:55 2021 -0700

    Merge pull request #15796: [BEAM-13108] Support JSON types in Storage API sink

commit 86d429a80306e5462c88250572673e3b83685664
Merge: 6220e476b2 5e3860acf7
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Wed Oct 27 10:11:13 2021 -0700

    Merge pull request #15808 from [BEAM-13118] Don't force push to master

    [BEAM-13118] Don't force push to master

commit 2c3e9799f759f039fcc6c33be60036f72065cbc6
Author: Aydar Farrakhov <stranniknm@gmail.com>
Date:   Wed Oct 27 17:19:13 2021 +0300

    [BEAM-13105] playground - add shorcut hint tooltip

commit 4e9e44d920b36f8aa89277ea580112ed5a9f03eb
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Wed Oct 27 14:40:52 2021 +0300

    [BEAM-12970][Playground]
    update processSuccess() method for compile step

commit 6220e476b2801a69823d23aba3a53612da841d5f
Merge: 0b9fb71b66 c4f0434aca
Author: Alexey Romanenko <33895511+aromanenko-dev@users.noreply.github.com>
Date:   Wed Oct 27 13:09:08 2021 +0200

    Merge pull request #15788: [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider (AWS sdk v2)

commit c4f0434acac303dee30c4f4a0105888cbfff2807
Author: mosche <mmack@talend.com>
Date:   Mon Oct 25 13:15:37 2021 +0200

    [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider (AWS sdk v2) rather than supporting basic credentials only.

commit 98499405768126a5f1180ad4a814f95e1c3cba73
Author: Eugene Nikolaiev <eugene.nikolayev@gmail.com>
Date:   Wed Oct 27 12:41:43 2021 +0300

    Fix Python docs build pre-commit failures.

commit 59868135b7be8c2701d1a278c9641f9dbe29ae2f
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Wed Oct 27 11:08:34 2021 +0300

    [BEAM-12970][Playground]
    simplify code;
    add using of logger;
    add documentation;

commit 0b9fb71b66f3b2ecf55b680f522c9d2147656bfb
Merge: 5cb634eb17 551c6d1010
Author: Heejong Lee <heejong@gmail.com>
Date:   Tue Oct 26 21:47:23 2021 -0700

    Merge pull request #15606 from ihji/BEAM-12978

    [BEAM-12978] Customizable dependency for Java external transform

commit 5cb634eb173451c6dc3a2b328afdf985f3135366
Author: reuvenlax <relax@google.com>
Date:   Tue Oct 26 16:24:40 2021 -0700

    [BEAM-13098] Fix translation of repeated TableRow fields (#15779)

commit 63e21b11e0b8fca3839c6a8a1631d1d80a453245
Merge: 95d1f9ad2f cbce59fd0e
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Tue Oct 26 16:07:31 2021 -0700

    [BEAM-11758] Update basics page: Splittable DoFn

commit 5e3860acf7c168cfc8d7822eac3295544c3daf21
Author: Andrew Pilloud <apilloud@google.com>
Date:   Tue Oct 26 15:59:27 2021 -0700

    [BEAM-13118] Don't force push to master

commit 95d1f9ad2f59187220f35ffc86206a1e449cd122
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Tue Oct 26 15:21:45 2021 -0700

    [BEAM-4149] Ensure that we always provide and require the worker id.

commit 3fe3e1545fbf31890b686199680fae909733de3e
Author: Luke Cwik <lcwik@google.com>
Date:   Tue Oct 26 15:20:40 2021 -0700

    [BEAM-13015] Migrate bundle processing in the SDK harness to using BeamFnDataInboundObserver2 and BeamFnDataGrpcMultiplexer2.

commit cbce59fd0e79a11571a9999e8f65039c9e433e1b
Author: Melissa Pashniak <melissapa@google.com>
Date:   Tue Oct 26 13:18:39 2021 -0700

    Address review feedback

commit 62b33a5bcd90ca1ef215e17b8e2d64d68c81615d
Author: Tianyang Hu <htyleo@gmail.com>
Date:   Tue Oct 26 11:41:55 2021 -0700

    Change sql.Options to an interface under sqlx. (#15790)

    The Options interface isn't supposed to be exposed to end users. This can also avoid potential circular dependencies.

commit 84e24ea01f4ac7be3c3a8caeb735199bf0a80435
Merge: 46c649a254 e096daf974
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Tue Oct 26 11:01:41 2021 -0700

    Merge pull request #15500 from [BEAM-6721] Set numShards dynamically for TextIO.write()

    [BEAM-6721] Set numShards dynamically for TextIO.write()

commit 46c649a2543f8f34e2cedf4702f70eb3cf1ab4f9
Merge: 49ae709e95 136eadc121
Author: Kyle Weaver <kcweaver@google.com>
Date:   Tue Oct 26 10:58:31 2021 -0700

    Merge pull request #15789 from aromanenko-dev/BEAM-13104-ParquetIO-filter

    [BEAM-13104] ParquetIO: SplitReadFn must read the whole block

commit 3bbcf5afbaa1da5c0878fc8535104adec3962051
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Tue Oct 26 18:58:29 2021 +0300

    [BEAM-12970][Playground]
    add setupCache() method;
    implement RunCode API method;
    change ExecutableName to a variable of LifeCycle instead of method;

commit 49ae709e95c6f5fcd88dd4aba86398c111180279
Author: daria.malkova <daria.malkova@akvelon.com>
Date:   Tue Oct 26 10:21:54 2021 +0300

    Merge pull request #15744 from [BEAM-13072][Playground] Executor builder

    * Add environment_service.go and structures for beam sdk, network envs and application envs

    * Add executor config structure to beam environment structure
    Fix tests, add new

    * add not yet supported

    * add java configuration file

    * Add executor builder

    * resolve conflicts with master

    * adapt server to new envs

    * Bugfix for a moved file

    * test bugfix

    Co-authored-by: Ilya Kozyrev <ilya.kozyrev@akvelon.com>

commit e6fc61e6af053f7f1aab75fc26ebecf3ae853b4e
Author: Reuven Lax <relax@google.com>
Date:   Mon Oct 25 21:27:22 2021 -0700

    support json

commit 0fb41701c22107e7938fa55be59b21b571ccd63c
Merge: a9ac63b10c fd4eb15d65
Author: Melissa Pashniak <melissapa@google.com>
Date:   Mon Oct 25 17:37:39 2021 -0700

    Merge branch 'master' into concepts4

commit fd4eb15d659e82bd370bd8d7cd7cb5f8fd174cbd
Merge: e1b83baeb5 9cfcfbe7d4
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Mon Oct 25 15:11:00 2021 -0700

    [BEAM-12522] Enable side inputs on all splittable DoFn execution time related methods.

commit e1b83baeb54d8fe1af2a200d7b5fde1c3c98ff3a
Merge: b52932c34c 480e52cedb
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Mon Oct 25 13:53:59 2021 -0700

    [BEAM-8543] Fix test filtering for Dataflow Runner V2 to exclude UsesStrictTimerOrdering

commit 480e52cedb307948a9a7684f084250a938b7d3d3
Author: Luke Cwik <lcwik@google.com>
Date:   Mon Oct 25 13:08:57 2021 -0700

    [BEAM-8543] Fix test filtering for Dataflow Runner V2 to exclude UsesStrictTimerOrdering

    The test names seem to have changed since they are not being excluded so swap to using test category exclusion. See https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/1378/testReport/

commit b52932c34cb5862068336711b4297a08bb9e47ef
Author: Aydar Farrakhov <stranniknm@gmail.com>
Date:   Mon Oct 25 21:50:20 2021 +0300

    Merge pull request #15783 from [BEAM-13048] [Playground] Add shortcuts

    * [BEAM-13048]: add keyboard shortcuts to playground

    * [BEAM-13048]: update shortcuts

    * [BEAM-13048]: fix lint errors

commit 9b3198fdf592ed69d8dbbce1d65c48f52c14b1f6
Merge: 39613ea89f d463c0c359
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Mon Oct 25 11:42:06 2021 -0700

    Merge pull request #15787 from [BEAM-13062][Playground] Update errors in Protobuf

    [BEAM-13062][Playground] Update errors in Protobuf

commit 39613ea89fee6ae888095fcb5ac9ca5fd6d687f9
Author: Melissa Pashniak <melissapa@google.com>
Date:   Mon Oct 25 11:26:28 2021 -0700

    [BEAM-11758] Update basics page: Aggregation, Runner, UDF, Schema (#15763)

    * [BEAM-11758] Update basics page: Aggregation, Runner, UDF, Schema

    * Address most review feedback

    * Fix type in intro list

    * Address remaining two feedback comments

commit b911642745e53015dd8b9dbcf8cb055f5713e35a
Author: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Mon Oct 25 21:25:27 2021 +0300

    Merge pull request #15770 from [BEAM-13095][Playground] Using working directory from environment in LifeCycle instead of using hardcoded backend directory

    * [BEAM-13095][Playground]
    Change the logic of 'lc` so that it uses workingDir

    * [BEAM-13095][Playground]
    Update comments;
    Add using of filepath.Join() to construct filePath;

    * [BEAM-13095][Playground]
    Fix comment

    * [BEAM-13095][Playground]
    update go.sum

commit 835d19ad8ef1756b306964f2f90b06b39165c2b5
Merge: 47a9b3fe45 aa26b53f63
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Mon Oct 25 11:22:07 2021 -0700

    Merge pull request #15654 from [BEAM-12998] [Playground] Environment service

    [BEAM-12998] [Playground] Environment service

commit 47a9b3fe453fb6baf8e63b596ca4aaa8ed960814
Author: Pavel Avilov <avilovpavel6@gmail.com>
Date:   Mon Oct 25 21:21:13 2021 +0300

    Merge pull request #15714 from [BEAM-13005] [Playground] Implement local cache for pipelines' states

    * Implement local cache for pipelines' states

    * [BEAM-13005][Playground]
    add context;
    add redis option to NewCache;

    * Edit GetValue method

    * [BEAM-13005][Playground]
    remove constructor from cache.go;
    rename constructor method from newLocalCache to New;
    move localCache files to new folder (local);
    add comments;

    * Resolve comments

    * [BEAM-13005][Playground]
    minor fix

    * add documentation for exported methods

    * fix documentation

    Co-authored-by: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
    Co-authored-by: Ilya Kozyrev <ilya.kozyrev@akvelon.com>

commit 43d3b90e5a066d1bb2fe80851c58e74162edc101
Author: Pavel Avilov <avilovpavel6@gmail.com>
Date:   Mon Oct 25 18:52:27 2021 +0300

    Merge pull request #15772 from [BEAM-13032] [Playground] Implement the Log service

    * Implement the Log service

    * Resolve comments

commit d463c0c35967e751892ca28e9c9d4f9ac4ec2c65
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Mon Oct 25 18:37:31 2021 +0300

    [BEAM-13062][Playground]
    update README file;
    generate files for backend

commit aa26b53f633847947c535b48b574cd652a1a0c3f
Author: Ilya Kozyrev <ilya.kozyrev@akvelon.com>
Date:   Mon Oct 25 18:33:34 2021 +0300

    Add environment_service.go and structures for beam sdk, network envs, cache and application envs

    Co-authored-by: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
    Co-authored-by: daria.malkova <daria.malkova@akvelon.com>

commit 136eadc121e136e25aafc2b65f130526e7f20142
Author: Alexey Romanenko <aromanenko.dev@gmail.com>
Date:   Mon Oct 25 17:21:47 2021 +0200

    [BEAM-13104] ParquetIO: SplitReadFn must read the whole block

commit 6e821f7bb03438ef7141da6415ba330caea7bc31
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Mon Oct 25 12:31:05 2021 +0300

    [BEAM-13062][Playground]
    add STATUS_COMPILE_ERROR;
    add STATUS_RUN_TIMEOUT;
    update proto command in README file to generate files;

commit 1f08d1f3ddc2e7bc7341be4b29bdafaec18de9cc
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Sun Oct 24 20:25:09 2021 -0700

    Fixing BigQueryIO request too big corner case for streaming inserts (#15067)

    * Rewriting for readability

    * Address comments

    * Address comments

    * Addressing comments. Simplifying logic

commit 551c6d1010335244c97e54ea13c2d552007bfc05
Author: Heejong Lee <heejong@gmail.com>
Date:   Thu Oct 21 21:01:12 2021 -0700

    add ConfigT param to getDependencies method

commit a9ac63b10c6d13e255e26424bc3e71c3bfd7aad7
Author: Melissa Pashniak <melissapa@google.com>
Date:   Thu Oct 21 19:06:01 2021 -0700

    [BEAM-11758] Update basics page: Splittable DoFn

commit 6173abb2e241865d89dff9ae679f4d422be84ee9
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Thu Oct 21 18:40:10 2021 -0700

    [BEAM-13015] Create a multiplexer that sends Elements based upon instruction id allowing for an inbound observer responsible for the entire instruction id. (#15747)

    * [BEAM-13015] Create a multiplexer that sends Elements based upon instruction id allowing for an inbound observer responsible for the entire instruction id.

    * fixup! checkstyle

    * Update sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/BeamFnDataGrpcMultiplexer2.java

    Co-authored-by: Brian Hulette <hulettbh@gmail.com>

    * fixup! Address PR comments.

    Co-authored-by: Brian Hulette <hulettbh@gmail.com>

commit 3d8213a1bc7376e95cea37abaa3f7f05730f2581
Author: Calvin Leung <calvinleungyk@users.noreply.github.com>
Date:   Thu Oct 21 16:02:57 2021 -0700

    [BEAM-11275] Support remote package download from remote filesystems in Stager (#15105)

    * [BEAM-11275] Updated CHANGES.md with new improvements

    * [BEAM-11275] Removed contextlib

    * [BEAM-11275] Added logic to download files from supported filesystems

    * [BEAM-11275] Update logs and catch larger scope Exception

    * [BEAM-11275] Formatting

    * [BEAM-11275] Download GCS file with FileSystems.open file handle

    * [BEAM-11275] Fixed file decompression issue

    * [BEAM-11275] Formatting

    * [BEAM-11275] Added tests for Stager._download_file

    * [BEAM-11275] Removed unused import

    * [BEAM-11275] Fix Python formatting

commit ca6f4f08437fe2fa7c2319293dfc4574c60a6929
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Thu Oct 21 14:48:46 2021 -0700

    lazy creation of source splits for export-based ReadFromBigQuery (#15610)

    * lazy creation of source ssplits

    * formatting

commit 8c143ab8dc2289c12fe4d7fc0b3042b0b518fda7
Merge: 975d71a5d6 30d1191580
Author: Daniel Oliveira <daniel.o.programmer@gmail.com>
Date:   Thu Oct 21 14:18:52 2021 -0700

    Merge pull request #15777: [BEAM-12830] Avoiding read-only Go module cache in Gradle config.

    [BEAM-12830] Avoiding read-only Go module cache in Gradle config.

commit 975d71a5d6311ed2ae33766581947de405fefabf
Author: kileys <kileysok@google.com>
Date:   Thu Oct 21 13:56:36 2021 -0700

    Test SetState addIfAbsent with no read (#15776)

commit a4acdb8ad4fdbe48f49606a1f70fcb2416f1b40b
Author: Melissa Pashniak <melissapa@google.com>
Date:   Thu Oct 21 13:22:10 2021 -0700

    [BEAM-11758] Update basics page: Pipeline, PCollection, PTransform (#15720)

    * [BEAM-11758] Update basics page: Pipeline, PCollection, PTransform

    * Address review feedback

    * Minor PCollection text tweaks

commit 406350249290ab7a702ed6c714db3fc84cda92aa
Author: Heejong Lee <heejong@gmail.com>
Date:   Thu Oct 21 12:53:09 2021 -0700

    rename variables

commit 30d119158057b48069d91c4c79afabb5e30bd93d
Author: Daniel Oliveira <daniel.o.programmer@gmail.com>
Date:   Thu Oct 21 12:30:59 2021 -0700

    Avoiding read-only Go module cache in Gradle config.

    ./gradlew cleanTest was getting various errors from Go due to the Go module caches inside /.gogradle directories being read-only, so clean was unable to delete them. I adjusted this with the following:

    1. Add -modcacherw to GOFLAGS on any commonly used gogradle tasks.
    2. Avoid using gofmt on nested Gradle modules, as it would try to format the contents of /.gogradle.

commit 76f531f42410999b8df3090afc203954f5d8ce1d
Author: Chris Gray <50027088+chrismgrayftsinc@users.noreply.github.com>
Date:   Thu Oct 21 11:56:39 2021 -0700

    [BEAM-13019] Add `containsInAnyOrder` with matchers to the `IterableAssert` interface (#15685)

    * [BEAM-13019] Add `containsInAnyOrder` with matchers to the `IterableAssert` interface

    * Fix the test.

    * Add a test

    * Fix a test

    * Fix another test.

    Confirmed all tests pass with `./gradlew compileTestJava`

    * Add a no-argument containsInAnyOrder to remove the ambiguity.

    * Update sdks/java/core/src/main/java/org/apache/beam/sdk/testing/PAssert.java

    * Update sdks/java/core/src/main/java/org/apache/beam/sdk/testing/PAssert.java

    Co-authored-by: Lukasz Cwik <lcwik@google.com>

commit e6f7f4415610ff78eb669a6351795c5811cd98da
Author: Robert Burke <lostluck@users.noreply.github.com>
Date:   Thu Oct 21 11:56:09 2021 -0700

    [BEAM-13096] Double test timeout. (#15774)

commit dc0548e20ca047cfa991d4138d63806e9d15086c
Author: Damon Douglas <damondouglas@users.noreply.github.com>
Date:   Thu Oct 21 16:17:13 2021 +0000

    Merge pull request #15761 from [BEAM-13008] Create gradle tasks for the Beam Playground

    * Implement Beam Playground gradle tasks

    * Fix trailing whitespace

    * Remove format from precommit

    * Fix order of includes and add descriptions

    * [BEAM-13008] add generated files and fix analysis issues (#2)

    * Reconcile errors with playgroundPrecommit output

    Co-authored-by: Aydar Farrakhov <stranniknm@gmail.com>

commit 9c8939b8011f9003da77df1a10978211d23d3fde
Author: Robert Burke <lostluck@users.noreply.github.com>
Date:   Wed Oct 20 19:16:38 2021 -0700

    [BEAM-13082] Re-use dataWriter buffer. (#15762)

commit 070ea22d507a2c26d838c872bb5790b8dad7f9b8
Author: Jack McCluskey <34928439+jrmccluskey@users.noreply.github.com>
Date:   Wed Oct 20 14:43:45 2021 -0400

    [BEAM-11087] Add default WindowMappingFn from Main to Side Input windows, validation test, unit tests (#15743)

commit 76535e701ec7fd917165bb6ff08883cf016f1e56
Merge: 59f41e59a4 c5b367c01e
Author: Tim Robertson <timrobertson100@gmail.com>
Date:   Wed Oct 20 20:26:52 2021 +0200

    Minor: corrections to flink runner docs (#15759)

commit 59f41e59a4833c306333c2f2a10c2f730d53c9e7
Merge: a05aa45dac b8ed280b83
Author: Kenn Knowles <kenn@apache.org>
Date:   Wed Oct 20 11:18:01 2021 -0700

    Merge pull request #15739: [BEAM-13073] Fixes Unexpected GC when using Java 11

commit c5b367c01e7a009bf142be2ad9a156b23f2f7fd0
Author: mosche <moritz@mackmail.net>
Date:   Wed Oct 20 17:59:05 2021 +0200

    adhoc: Minor update to flink runner docs

commit a05aa45dac5e7295a56634f0916b7019bc6782e5
Merge: 8578c9a935 f7691e691d
Author: Etienne Chauchot <echauchot@apache.org>
Date:   Wed Oct 20 09:38:36 2021 +0200

    Merge pull request #15381 from egalpin/BEAM-10990-elasticsearch-response-filtering

    Merge pull request #15381: [BEAM-10990] Elasticsearch response filtering and [BEAM-5172] Tries to reduce ES UTest flakiness

commit 8578c9a9352a8a5c9621647e9c585321f9761dc5
Author: Chamikara Jayalath <chamikara@apache.org>
Date:   Tue Oct 19 20:03:08 2021 -0700

    [BEAM-13079] Updates cross-language transform URNs to use the new convention (#15748)

    * Updates cross-language transform URNs to use the new convention

    * Fix the Spanner Insert URN.

    Co-authored-by: Brian Hulette <hulettbh@gmail.com>

    * Fix the Kafka test

    * Fixes the Pub/Sub test failure

    Co-authored-by: Brian Hulette <hulettbh@gmail.com>

commit 4d1c2af0b22058a74e14aa3002efba7ebb8bb632
Merge: bfe5feabf9 90251e631b
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Tue Oct 19 16:23:00 2021 -0700

    Merge pull request #15750 from [BEAM-13077][Playground] LifeCycle.CreateFolders() after several uses returns error

    [BEAM-13077][Playground] LifeCycle.CreateFolders() after several uses returns error

commit bfe5feabf9a70aa250c1142b01f4379e1f124d6e
Merge: b76c7ee041 8892810ad0
Author: Kyle Weaver <kcweaver@google.com>
Date:   Tue Oct 19 12:52:02 2021 -0700

    Merge pull request #15755 from ibzib/depth1

    [BEAM-13055] Use unshallow clone to create PR.

commit 8892810ad04b9c16f59334be5c2954fe2204a0a2
Author: Kyle Weaver <kcweaver@google.com>
Date:   Tue Oct 19 11:10:12 2021 -0700

    [BEAM-13055] Use unshallow clone to create PR.

commit b76c7ee041b10941d5de18a083fa5ee4a6626e48
Merge: aa4edda39c 650b514618
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Tue Oct 19 10:35:10 2021 -0700

    Merge pull request #15656 from [BEAM-12983] [Playground] Initial gRPC server

    [BEAM-12983] [Playground] Initial gRPC server

commit aa4edda39ceb8d7a80f56bd37caa6233dba7de5d
Merge: a4dc6f3b8e 63d9c621e1
Author: Yichi Zhang <zyichi@google.com>
Date:   Tue Oct 19 08:58:26 2021 -0700

    Merge pull request #15716 from scwhittle/fix_unexpected_blocking

    [BEAM-13042] Prevent unexpected blocking in RegisterAndProcessBundleOperation.hasFailed

commit a4dc6f3b8ee64d9897e9c045f8b1acbbc008edd2
Author: Tianyang Hu <htyleo@gmail.com>
Date:   Tue Oct 19 08:49:38 2021 -0700

    [BEAM-13068] Add a SQL API in Beam Go SDK (#15746)

    * Add a SQL API in Beam Go SDK
    * User-specified expansionAddr shouldn't be overridden.

commit f7691e691d8600bc5b70539c07ed0eb843955b04
Author: egalpin <egalpin@users.noreply.github.com>
Date:   Wed Aug 25 09:30:42 2021 -0400

    [BEAM-5172] Tries to reduce ES uTest flakiness

commit 6bfd83d44aa27667773a8025a5a4bcb6a847a367
Author: egalpin <egalpin@users.noreply.github.com>
Date:   Fri Aug 13 14:16:01 2021 -0400

    [BEAM-10990] Adds response filtering for ElasticsearchIO

commit 90251e631beee35f1847025147d55227f3ba999d
Author: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com>
Date:   Tue Oct 19 14:01:57 2021 +0300

    [BEAM_13077][Playground]
    fix logic for CreateFolders method

commit 650b514618001f53755d62e52f17a5351501cd42
Author: Ilya Kozyrev <ilya.kozyrev@akvelon.com>
Date:   Tue Oct 19 12:40:51 2021 +0300

    Implement initial server with grpcweb wrapper

commit 70ac565ea71f247fbe545489a5916ed058f4ddac
Merge: abe3aa768e d0253ed545
Author: Lukasz Cwik <lukecwik@gmail.com>
Date:   Mon Oct 18 16:26:01 2021 -0700

    [BEAM-13015] Implement a simplified cancellable blocking queue with similar semantics to ArrayBlockingQueue.

commit d0253ed54535e00c61d6c3e04d68f35bbf2d46f9
Author: Luke Cwik <lcwik@google.com>
Date:   Fri Oct 15 15:53:22 2021 -0700

    [BEAM-13015] Implement a simplified cancellable blocking queue with similar semantics to ArrayBlockingQueue.

    There are a few places where we use a "POISON" object to signal the end of the queue. This implementation can more safely replace those.

commit abe3aa768e1e3bd4ece9d1bf4cba31424b0ec341
Merge: ffde2a6020 9343f37cf7
Author: Kyle Weaver <kcweaver@google.com>
Date:   Mon Oct 18 13:24:04 2021 -0700

    Merge pull request #15603 from zhoufek/fat

    [BEAM-9487] Various Trigger.may_lose_data fixes

commit ffde2a60205d920749787a67d64a0f2af199ba35
Merge: debbd7121d a9ec3c8d94
Author: Robert Bradshaw <robertwb@google.com>
Date:   Mon Oct 18 11:54:35 2021 -0700

    Merge pull request #15719 from [BEAM-13040] Revert breaking PR and add some test cases.

commit debbd7121dcbdbbe44fd3e6b89db8c53568c18b2
Author: Tianyang Hu <htyleo@gmail.com>
Date:   Mon Oct 18 11:51:03 2021 -0700

    [BEAM-13068] Add xlangx.DecodeStructPayload (#15741)

commit 8e6d8de34beaf3afa4faf38703b1bc12a2212329
Merge: 85a122735f 279949d025
Author: Andrew Pilloud <apilloud@users.noreply.github.com>
Date:   Mon Oct 18 11:26:21 2021 -0700

    Merge pull request #15728: [BEAM-12393] sql support for Zeta Sql

commit 85a122735f84c0ee46ba0fb583d9ff9e05dcf2fc
Author: Benjamin Gonzalez <74670721+benWize@users.noreply.github.com>
Date:   Mon Oct 18 13:11:10 2021 -0500

    [BEAM-11936] Fix some errorprone warnings (#15648)

    * [BEAM-11936] Fix errorprone AutoValueFinalMethods warnings

    * [BEAM-11936] Fix errorprone warnings: AssignmentToMock, AnnotateFormatMethod, BadImport

    * [BEAM-11936] Fix errorprone warnings: JodaToSelf, MathAbsoluteRandom, BigDecimalLiteralDouble, JodaDurationConstructor

    * [BEAM-11936] Fix errorprone warnings: UnusedMethod, UnnecessaryParentheses

    * [BEAM-11936] Fix spotlessApply, fix errorprone warnings

    * [BEAM-11936] Fix dependency errors, add supresswarning

    * [BEAM-11936] Fix dependency errors, add supresswarning

    * [BEAM-11936] Fix dependency errors, add supresswarning

    * [BEAM-11936] Fix errorprone warnings: AnnotateFormatMethod, add errorprone dependency as compileOnly

    * [BEAM-11936] Add errorprone dependency to samza project as compileOnly

    * [BEAM-11936] Add FormatStringAnnotation, change errorprone dependencies to common dependencies

commit bf91bd75ea0e66b5fe1f47b73ab85f382f550203
Merge: de396a6fd1 fb6d5546e7
Author: Pablo <pabloem@users.noreply.github.com>
Date:   Mon Oct 18 11:10:31 2021 -0700

    Merge pull request #15645 from [BEAM-12988] [Playground] Add FileSystem service

    [BEAM-12988] [Playground] Add FileSystem service

commit de396a6fd169a1dac20d6f97c9115b1ba12e3cd2
Author: Robert Bradshaw <robertwb@google.com>
Date:   Mon Oct 18 10:29:51 2021 -0700

    [BEAM-13066] Produce abstract iterables from IterableCoder. (#15662)

    Currently this will non-deterministically produce lists, generally for
    small data, which makes it easy to write code that works in tests but
    not in production.

commit b8ed280b83cd89053aabd1ec5548ae028f8d82c6
Author: Luís Bianchin <labianchin@users.noreply.github.com>
Date:   Mon Oct 18 14:27:16 2021 +0200

    Add -XX:+AlwaysActAsServerClassMachine to J…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants