Skip to content

sync-up DSL_SQL from Master#3314

Merged
asfgit merged 728 commits into
DSL_SQLfrom
master
Jun 8, 2017
Merged

sync-up DSL_SQL from Master#3314
asfgit merged 728 commits into
DSL_SQLfrom
master

Conversation

@mingmxu
Copy link
Copy Markdown

@mingmxu mingmxu commented Jun 7, 2017

pull latest code from master branch to DSL_SQL branch.

cph6 and others added 30 commits May 23, 2017 08:39
…the default jar.

Signed-off-by: Jason Kuster <jasonkuster@google.com>
This reverts commit 9336230.

It appears to break the BigQueryTornadoesIT.
…ext to what we actually need

  Remove unused pieces of DirectStepContext
  Revise StepContext javadoc
  Shorten excessive name in DirectExecutionContext
  Delete unused BaseStepContext
  Delete unused remnants in DirectExecutionContext
  Remove unused StepContext name methods
  Delete unused ExecutionContext
  Inline and delete BaseExecutionContext
  Remove writePCollectionViewData from the Beam codebase
  Implement StepContext directly in the DirectRunner
  Remove extraneous ExecutionContext parameter to BaseStepContext
  Move BaseStepContext to the top level
  Rename BaseExecutionContext.StepContext to BaseStepContext
  Remove StepContext.noteOutput
  Move StepContext to top level
This is to give a standard and obvious suffix for all our helper classes
for translating to/from Runner API protos.
bchambers and others added 19 commits June 6, 2017 15:08
Also revise the Javadoc on MetricsContainers.
Assume Spanner database exists.
Before, the config snapshot was not deserializable because there was no
default constructor and read()/write() where not implemented.

This also changes the compatibility-check logic to compare the class
name of the Coder to avoid serializing the coder using Java
Serialization.
Before, there was no call to setNextWatermarkTimer() in case the source
had multiple Readers.

This also adds a test for watermark emission to
UnboundedSourceWrapperTest.
@mingmxu
Copy link
Copy Markdown
Author

mingmxu commented Jun 7, 2017

R: @davorbonaci
CC: @jbonofre @xumingming

@mingmxu
Copy link
Copy Markdown
Author

mingmxu commented Jun 7, 2017

@davorbonaci, could you merge this directly? I'll follow with another PR to solve the errors.

@asfgit asfgit merged commit 32f22b7 into DSL_SQL Jun 8, 2017
asfgit pushed a commit that referenced this pull request Jun 8, 2017
@davorbonaci
Copy link
Copy Markdown
Member

Sure -- merged (since this is a feature branch). Please fix it up sooner rather than later.

@davorbonaci
Copy link
Copy Markdown
Member

Merged; please close.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.