Skip to content

[Streaming][Doc] Remove duplicated description about WAL #6719

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
sarutak wants to merge 1 commit into from
Closed

[Streaming][Doc] Remove duplicated description about WAL #6719

sarutak wants to merge 1 commit into from
+1 −1

Conversation

@sarutak
Copy link
Member

@sarutak sarutak commented Jun 9, 2015

I noticed there is a duplicated description about WAL.

To ensure zero-data loss, you have to additionally enable Write Ahead Logs in Spark Streaming. To ensure zero data loss, enable the Write Ahead Logs (introduced in Spark 1.2).

Let's remove the duplication.

I don't file this issue in JIRA because it's minor.

@srowen
Copy link
Member

srowen commented Jun 9, 2015

LGTM

@asfgit asfgit closed this in e6fb6ce Jun 9, 2015
@SparkQA
Copy link

SparkQA commented Jun 9, 2015

Test build #34496 has finished for PR 6719 at commit cc9bb21.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class SimpleFunctionRegistry extends FunctionRegistry
    • case class Rand(seed: Long) extends RDG(seed)
    • case class Randn(seed: Long) extends RDG(seed)
    • class StringKeyHashMap[T](normalizer: (String) => String)

nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
@sarutak @nemccarthy
[STREAMING] [DOC] Remove duplicated description about WAL
164649c 
I noticed there is a duplicated description about WAL.

```
To ensure zero-data loss, you have to additionally enable Write Ahead Logs in Spark Streaming. To ensure zero data loss, enable the Write Ahead Logs (introduced in Spark 1.2).
```

Let's remove the duplication.

I don't file this issue in JIRA because it's minor.

Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp>

Closes apache#6719 from sarutak/remove-multiple-description and squashes the following commits:

cc9bb21 [Kousuke Saruta] Removed duplicated description about WAL
@sarutak sarutak deleted the remove-multiple-description branch April 12, 2016 13:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@sarutak @srowen @SparkQA