Skip to content

[SPARK-36037][TESTS][FOLLOWUP] Avoid wrong test results on daylight saving time#33354

Closed
gengliangwang wants to merge 1 commit intoapache:masterfrom
gengliangwang:FIxDST
Closed

[SPARK-36037][TESTS][FOLLOWUP] Avoid wrong test results on daylight saving time#33354
gengliangwang wants to merge 1 commit intoapache:masterfrom
gengliangwang:FIxDST

Conversation

@gengliangwang
Copy link
Member

What changes were proposed in this pull request?

Only use the zone ids that has no daylight saving for testing localtimestamp

Why are the changes needed?

#33346 (comment) @MaxGekk suggests that we should avoid wrong results if possible.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Unit test

@SparkQA
Copy link

SparkQA commented Jul 15, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45569/

@SparkQA
Copy link

SparkQA commented Jul 15, 2021

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45569/

test("datetime function localtimestamp") {
outstandingTimezonesIds.foreach { zid =>
// Verify with multiple outstanding time zones which has no daylight saving time.
Seq("UTC", "Africa/Dakar", "Asia/Hong_Kong").foreach { zid =>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Copy link
Member

@MaxGekk MaxGekk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Merging to master/3.2. GA passed.
Screenshot 2021-07-15 at 11 38 11
Thank you, @gengliangwang and @beliefer for review.

MaxGekk pushed a commit that referenced this pull request Jul 15, 2021
…aving time

### What changes were proposed in this pull request?

Only use the zone ids that has no daylight saving for testing `localtimestamp`

### Why are the changes needed?

#33346 (comment) MaxGekk suggests that we should avoid wrong results if possible.

### Does this PR introduce _any_ user-facing change?

No
### How was this patch tested?

Unit test

Closes #33354 from gengliangwang/FIxDST.

Authored-by: Gengliang Wang <gengliang@apache.org>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
(cherry picked from commit 564d3de)
Signed-off-by: Max Gekk <max.gekk@gmail.com>
@MaxGekk MaxGekk closed this in 564d3de Jul 15, 2021
@SparkQA
Copy link

SparkQA commented Jul 15, 2021

Test build #141054 has finished for PR 33354 at commit 867b2f7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants