Skip to content

[BEAM-2380] Forward additional outputs to DoFnRunner in Flink Batch#3258

Merged
asfgit merged 2 commits into
apache:masterfrom
aljoscha:jira-2380-fix-flink-batch-add-outputs
May 30, 2017
Merged

[BEAM-2380] Forward additional outputs to DoFnRunner in Flink Batch#3258
asfgit merged 2 commits into
apache:masterfrom
aljoscha:jira-2380-fix-flink-batch-add-outputs

Conversation

@aljoscha
Copy link
Copy Markdown
Contributor

R: @iemejia or anyone, really 😃

@aljoscha
Copy link
Copy Markdown
Contributor Author

Run Flink ValidatesRunner

@aljoscha
Copy link
Copy Markdown
Contributor Author

@asfbot
Copy link
Copy Markdown

asfbot commented May 30, 2017

Build finished.
--none--

1 similar comment
@asfbot
Copy link
Copy Markdown

asfbot commented May 30, 2017

Build finished.
--none--

Before, we only flushed all pushed-back data when receiving a +Inf
watermark on the side input. It can happen that we receive that
watermark before getting any data on the main input. This changes
DoFnOperator to also flush when receiving a main-input watermark and we
happen to have already received the +Inf watermark on the side input.

Some tests where Flaky because of this. One example was
ViewTest.testWindowedSideInputFixedToFixedWithDefault().
@aljoscha
Copy link
Copy Markdown
Contributor Author

Run Flink ValidatesRunner

@asfbot
Copy link
Copy Markdown

asfbot commented May 30, 2017

Build finished.
--none--

@aljoscha
Copy link
Copy Markdown
Contributor Author

@asfbot
Copy link
Copy Markdown

asfbot commented May 30, 2017

Build finished.
--none--

@jbonofre
Copy link
Copy Markdown
Member

retest this please

@jbonofre
Copy link
Copy Markdown
Member

Run Flink ValidatesRunner

@asfbot
Copy link
Copy Markdown

asfbot commented May 30, 2017

--none--

1 similar comment
@asfbot
Copy link
Copy Markdown

asfbot commented May 30, 2017

--none--

@dhalperi
Copy link
Copy Markdown
Contributor

LGTM, thanks!

cc: @tgroh

@asfgit asfgit merged commit 838035a into apache:master May 30, 2017
asfgit pushed a commit that referenced this pull request May 30, 2017
@iemejia
Copy link
Copy Markdown
Member

iemejia commented May 30, 2017

Thanks for merging @dhalperi I was AFK most of the day but expected to do it later on.

@aljoscha aljoscha deleted the jira-2380-fix-flink-batch-add-outputs branch May 31, 2017 08:36
@aljoscha
Copy link
Copy Markdown
Contributor Author

Thanks @dhalperi!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants