Skip to content

Conversation

@rxin
Copy link
Contributor

@rxin rxin commented Oct 24, 2015

Adds DataFrameReader.text and DataFrameWriter.text.

@SparkQA
Copy link

SparkQA commented Oct 24, 2015

Test build #44278 has finished for PR 9259 at commit f0e7201.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 24, 2015

Test build #44282 has finished for PR 9259 at commit ce990e9.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 24, 2015

Test build #44287 has finished for PR 9259 at commit ac7ea41.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):\n * class DefaultSource extends HadoopFsRelationProvider with DataSourceRegister\n * class TextOutputWriter(path: String, dataSchema: StructType, context: TaskAttemptContext)\n

@SparkQA
Copy link

SparkQA commented Oct 24, 2015

Test build #44289 has finished for PR 9259 at commit b6ecf90.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor Author

rxin commented Oct 25, 2015

cc @davies

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also support multiple files or directories, as for parquet?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could be a good idea. If we do that maybe we should do it for all data sources though, and maybe not part of this?

@yhuai
Copy link
Contributor

yhuai commented Oct 28, 2015

merging to master.

@asfgit asfgit closed this in 5aa0521 Oct 28, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants