Skip to content

Translate reads/sources through the Runner API#3635

Closed
robertwb wants to merge 3 commits into
apache:masterfrom
robertwb:runner-api-read-good
Closed

Translate reads/sources through the Runner API#3635
robertwb wants to merge 3 commits into
apache:masterfrom
robertwb:runner-api-read-good

Conversation

@robertwb

Copy link
Copy Markdown
Contributor

Follow this checklist to help us incorporate your contribution quickly and easily:

  • Make sure there is a JIRA issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes.
  • Each commit in the pull request should have a meaningful subject line and body.
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.
  • Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
  • Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

@robertwb robertwb force-pushed the runner-api-read-good branch from 61db58c to a2e097e Compare July 25, 2017 00:46
@robertwb robertwb changed the title Runner api read good Translate reads/sources through the Runner API Jul 25, 2017
@robertwb

Copy link
Copy Markdown
Contributor Author

R: @sb2nov

@coveralls

Copy link
Copy Markdown

Coverage Status

Coverage decreased (-0.08%) to 70.512% when pulling a2e097e on robertwb:runner-api-read-good into 0064fb3 on apache:master.

Comment thread sdks/python/apache_beam/io/iobase.py Outdated

@staticmethod
def from_runner_api_parameter(parameter, context):
return Read(BoundedSource.from_runner_api(parameter.source, context))

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this always a bounded source? based on the to_runner_api function it can be both bounded and unbounded

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because we don't have an UnboundedSource. We do, however, have a (separate) NativeSource which I just now realized may be an issue. Made a common superclass.

@robertwb robertwb force-pushed the runner-api-read-good branch from 6ab3faf to 210c857 Compare July 25, 2017 20:35
@sb2nov

sb2nov commented Jul 25, 2017

Copy link
Copy Markdown
Contributor

LGTM if tests pass.

@robertwb

Copy link
Copy Markdown
Contributor Author

Irrelevant java failure. Retest this please.

@coveralls

Copy link
Copy Markdown

Coverage Status

Changes Unknown when pulling 210c857 on robertwb:runner-api-read-good into ** on apache:master**.

@asfgit asfgit closed this in b67a30b Jul 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants