Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-18182] Expose ReplayListenerBus.read() overload which takes string iterator #15698

Closed

Conversation

JoshRosen
Copy link
Contributor

The ReplayListenerBus.read() method is used when implementing a custom ApplicationHistoryProvider. The current interface only exposes a read() method which takes an InputStream and performs stream-to-lines conversion itself, but it would also be useful to expose an overloaded method which accepts an iterator of strings, thereby enabling events to be provided from non-InputStream sources.

@SparkQA
Copy link

SparkQA commented Oct 31, 2016

Test build #67828 has finished for PR 15698 at commit b777ee5.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14
Copy link
Contributor

LGTM retest this please

@SparkQA
Copy link

SparkQA commented Nov 1, 2016

Test build #67917 has finished for PR 15698 at commit b777ee5.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor

rxin commented Nov 1, 2016

Merging in master.

@asfgit asfgit closed this in b929537 Nov 1, 2016
@JoshRosen JoshRosen deleted the replay-listener-bus-interface branch November 1, 2016 23:56
uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
…ring iterator

The `ReplayListenerBus.read()` method is used when implementing a custom `ApplicationHistoryProvider`. The current interface only exposes a `read()` method which takes an `InputStream` and performs stream-to-lines conversion itself, but it would also be useful to expose an overloaded method which accepts an iterator of strings, thereby enabling events to be provided from non-`InputStream` sources.

Author: Josh Rosen <joshrosen@databricks.com>

Closes apache#15698 from JoshRosen/replay-listener-bus-interface.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants