Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-39035][SQL][TESTS] Add tests for options from to_csv and from_csv. #36401

Closed
wants to merge 4 commits into from

Conversation

itholic
Copy link
Contributor

@itholic itholic commented Apr 29, 2022

What changes were proposed in this pull request?

This PR proposes to fill up the missing test for options from CSV read/write functions.

Why are the changes needed?

For better testability and correct the documents.

Does this PR introduce any user-facing change?

No, it's dev-only.

How was this patch tested?

Added some UTs for CSV read/write options.

@github-actions github-actions bot added the SQL label Apr 29, 2022
HyukjinKwon
HyukjinKwon previously approved these changes Apr 29, 2022
Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if tests pass. cc @tgravescs FYI

@HyukjinKwon
Copy link
Member

Merged to master.

@HyukjinKwon
Copy link
Member

HyukjinKwon commented Apr 29, 2022

Sorry, the tests failed https://github.com/apache/spark/runs/6226791783 when ANSI mode (spark.sql.ansi.enabled) is enabled (that's currently not being tested in a PR builder).

@itholic can you run the tests with this mode, and make it pass regardless of this configuration?

@HyukjinKwon
Copy link
Member

I reverted this.

@HyukjinKwon HyukjinKwon reopened this Apr 29, 2022
@HyukjinKwon HyukjinKwon dismissed their stale review April 29, 2022 11:29

Approval dismissed since this got reverted.

@itholic itholic changed the title [SPARK-39035][SQL][TESTS][DOCS] Add tests for options from to_csv and from_csv. [SPARK-39035][SQL][TESTS] Add tests for options from to_csv and from_csv. Apr 30, 2022
@HyukjinKwon
Copy link
Member

Merged to master.

@itholic itholic deleted the SPARK-39035 branch April 22, 2023 05:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
3 participants