Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Spark-21123][Docs][Structured Streaming] Options for file stream source are in a wrong table #18342

Closed
wants to merge 2 commits into from

Conversation

assafmendelson
Copy link

What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This pull request has two commits: The first includes changes to the version as it appeared in spark 2.1 and the second handled an additional option added for spark 2.2

How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

The original documentation was written by @tdas and @lw-lin

Copy link
Member

@srowen srowen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe you're correct. CC @tdas @lw-lin

@SparkQA
Copy link

SparkQA commented Jun 18, 2017

Test build #3801 has finished for PR 18342 at commit 13ff475.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@assafmendelson assafmendelson changed the title [Spark 21123][Docs][Structured Streaming] Options for file stream source are in a wrong table [Spark-21123][Docs][Structured Streaming] Options for file stream source are in a wrong table Jun 18, 2017
@lw-lin
Copy link
Contributor

lw-lin commented Jun 19, 2017

This lgtm; @zsxwing please also take a look

@zsxwing
Copy link
Member

zsxwing commented Jun 19, 2017

LGTM. Merging to master and 2.2. @assafmendelson could you also submit a PR to fix branch-2.1? Thanks!

asfgit pushed a commit that referenced this pull request Jun 19, 2017
…rce are in a wrong table

## What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This pull request has two commits: The first includes changes to the version as it appeared in spark 2.1 and the second handled an additional option added for spark 2.2

## How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

The original documentation was written by tdas and lw-lin

Author: assafmendelson <assaf.mendelson@gmail.com>

Closes #18342 from assafmendelson/spark-21123.

(cherry picked from commit 66a792c)
Signed-off-by: Shixiong Zhu <shixiong@databricks.com>
@zsxwing
Copy link
Member

zsxwing commented Jun 19, 2017

@assafmendelson do you have an Apache JIRA account? I'm going to assign this ticket to you.

@asfgit asfgit closed this in 66a792c Jun 19, 2017
@assafmendelson
Copy link
Author

@zsxwing My jira account is assaf.mendelson.

asfgit pushed a commit that referenced this pull request Jun 20, 2017
…rce are in a wrong table - version to fix 2.1

## What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This commit continues on PR #18342 and targets the fixes for the documentation of version spark version 2.1

## How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

zsxwing This is the PR to fix version 2.1 as discussed in PR #18342

Author: assafmendelson <assaf.mendelson@gmail.com>

Closes #18363 from assafmendelson/spark-21123-for-spark2.1.
robert3005 pushed a commit to palantir/spark that referenced this pull request Jun 29, 2017
…rce are in a wrong table

## What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This pull request has two commits: The first includes changes to the version as it appeared in spark 2.1 and the second handled an additional option added for spark 2.2

## How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

The original documentation was written by tdas and lw-lin

Author: assafmendelson <assaf.mendelson@gmail.com>

Closes apache#18342 from assafmendelson/spark-21123.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants