Skip to content

[SPARK-35812][PYTHON] Throw ValueError if version and timestamp are used together in to_delta#33023

Closed
Yikun wants to merge 2 commits intoapache:masterfrom
Yikun:SPARK-35812
Closed

[SPARK-35812][PYTHON] Throw ValueError if version and timestamp are used together in to_delta#33023
Yikun wants to merge 2 commits intoapache:masterfrom
Yikun:SPARK-35812

Conversation

@Yikun
Copy link
Member

@Yikun Yikun commented Jun 22, 2021

What changes were proposed in this pull request?

Throw ValueError if version and timestamp are used together in to_delta

Why are the changes needed?

read_delta has arguments named version and timestamp, but they cannot be used together.

We should raise the proper error message when they are used together.

Does this PR introduce any user-facing change?

No

How was this patch tested?

UT

@Yikun
Copy link
Member Author

Yikun commented Jun 22, 2021

cc @itholic @ueshin @HyukjinKwon

@SparkQA
Copy link

SparkQA commented Jun 22, 2021

Test build #140141 has finished for PR 33023 at commit 4352eea.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jun 22, 2021

Kubernetes integration test unable to build dist.

exiting with code: 1
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44669/

@HyukjinKwon
Copy link
Member

cc @cloud-fan

4 14
"""
if version is not None and timestamp is not None:
raise ValueError("version and timestamp cannot be used together.")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how about the document?

Copy link
Member Author

@Yikun Yikun Jun 23, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added the doc for version and timestamp

@SparkQA
Copy link

SparkQA commented Jun 23, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44721/

@SparkQA
Copy link

SparkQA commented Jun 23, 2021

Test build #140194 has finished for PR 33023 at commit 118b5b7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jun 23, 2021

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44721/

@HyukjinKwon
Copy link
Member

Merged to master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants