Skip to content

Conversation

@srowen
Copy link
Member

@srowen srowen commented Oct 23, 2019

What changes were proposed in this pull request?

Recent timezone definition changes in very new JDK 8 (and beyond) releases cause test failures. The below was observed on JDK 1.8.0_232. As before, the easy fix is to allow for these inconsequential variations in test results due to differing definition of timezones.

Why are the changes needed?

Keeps test passing on the latest JDK releases.

Does this PR introduce any user-facing change?

None

How was this patch tested?

Existing tests

@srowen srowen self-assigned this Oct 23, 2019
// There are some days are skipped entirely in some timezone, skip them here.
val skipped_days = Map[String, Set[Int]](
"Kwajalein" -> Set(8632, 8633),
"Kwajalein" -> Set(8632, 8633, 8634),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you put the JDK / OS version for this into the PR description, please?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I updated the JDK version. I'll ask the reporter to comment here with more details. That said, I think this is an obvious fix so I'm not too worried about those details. It doesn't happen on 1.8.0_222 at least.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When we encountered, this test failed on jdk 1.8.0_232

Copy link
Member

@dongjoon-hyun dongjoon-hyun Oct 24, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

And, which OS did you used?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I assume it's Linux @darshan-pandya but would it matter? Java uses its own TZ info rather than anything from the OS.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just out of curiosity, 😄 .

@SparkQA
Copy link

SparkQA commented Oct 24, 2019

Test build #112565 has finished for PR 26236 at commit cbeccdc.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen srowen closed this in a35fb4f Oct 24, 2019
@srowen
Copy link
Member Author

srowen commented Oct 24, 2019

Merged to master

@srowen srowen deleted the SPARK-29578 branch October 26, 2019 20:50
srowen added a commit to srowen/spark that referenced this pull request Jan 29, 2020
…timzeone due to more recent timezone updates in later JDK 8

### What changes were proposed in this pull request?

Recent timezone definition changes in very new JDK 8 (and beyond) releases cause test failures. The below was observed on JDK 1.8.0_232. As before, the easy fix is to allow for these inconsequential variations in test results due to differing definition of timezones.

### Why are the changes needed?

Keeps test passing on the latest JDK releases.

### Does this PR introduce any user-facing change?

None

### How was this patch tested?

Existing tests

Closes apache#26236 from srowen/SPARK-29578.

Authored-by: Sean Owen <[email protected]>
Signed-off-by: Sean Owen <[email protected]>
dongjoon-hyun pushed a commit that referenced this pull request Jan 30, 2020
…lein timzeone due to more recent timezone updates in later JDK 8

(Backport of #26236)

### What changes were proposed in this pull request?

Recent timezone definition changes in very new JDK 8 (and beyond) releases cause test failures. The below was observed on JDK 1.8.0_232. As before, the easy fix is to allow for these inconsequential variations in test results due to differing definition of timezones.

### Why are the changes needed?

Keeps test passing on the latest JDK releases.

### Does this PR introduce any user-facing change?

None

### How was this patch tested?

Existing tests

Closes #27386 from srowen/SPARK-29578.2.

Authored-by: Sean Owen <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
rshkv pushed a commit to palantir/spark that referenced this pull request Apr 8, 2020
…timzeone due to more recent timezone updates in later JDK 8

Recent timezone definition changes in very new JDK 8 (and beyond) releases cause test failures. The below was observed on JDK 1.8.0_232. As before, the easy fix is to allow for these inconsequential variations in test results due to differing definition of timezones.

Keeps test passing on the latest JDK releases.

None

Existing tests

Closes apache#26236 from srowen/SPARK-29578.

Authored-by: Sean Owen <[email protected]>
Signed-off-by: Sean Owen <[email protected]>
rshkv pushed a commit to palantir/spark that referenced this pull request Apr 20, 2020
…timzeone due to more recent timezone updates in later JDK 8

Recent timezone definition changes in very new JDK 8 (and beyond) releases cause test failures. The below was observed on JDK 1.8.0_232. As before, the easy fix is to allow for these inconsequential variations in test results due to differing definition of timezones.

Keeps test passing on the latest JDK releases.

None

Existing tests

Closes apache#26236 from srowen/SPARK-29578.

Authored-by: Sean Owen <[email protected]>
Signed-off-by: Sean Owen <[email protected]>
rshkv pushed a commit to palantir/spark that referenced this pull request May 1, 2020
…timzeone due to more recent timezone updates in later JDK 8

Recent timezone definition changes in very new JDK 8 (and beyond) releases cause test failures. The below was observed on JDK 1.8.0_232. As before, the easy fix is to allow for these inconsequential variations in test results due to differing definition of timezones.

Keeps test passing on the latest JDK releases.

None

Existing tests

Closes apache#26236 from srowen/SPARK-29578.

Authored-by: Sean Owen <[email protected]>
Signed-off-by: Sean Owen <[email protected]>
rshkv pushed a commit to palantir/spark that referenced this pull request May 1, 2020
…timzeone due to more recent timezone updates in later JDK 8

Recent timezone definition changes in very new JDK 8 (and beyond) releases cause test failures. The below was observed on JDK 1.8.0_232. As before, the easy fix is to allow for these inconsequential variations in test results due to differing definition of timezones.

Keeps test passing on the latest JDK releases.

None

Existing tests

Closes apache#26236 from srowen/SPARK-29578.

Authored-by: Sean Owen <[email protected]>
Signed-off-by: Sean Owen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants