Skip to content

[SPARK-53225][BUILD] Upgrade datasketches-java to 7.0.1 and datasketches-memory to 4.1.0#51951

Closed
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-53225
Closed

[SPARK-53225][BUILD] Upgrade datasketches-java to 7.0.1 and datasketches-memory to 4.1.0#51951
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-53225

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Aug 9, 2025

What changes were proposed in this pull request?

This PR aims to upgrade

  • datasketches-java from 6.2.0 to 7.0.1
  • datasketches-memory from 3.0.2 to 4.1.0.

Why are the changes needed?

To bring the latest improvements and bug fixes.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun dongjoon-hyun marked this pull request as draft August 9, 2025 07:22
@github-actions github-actions bot added the BUILD label Aug 9, 2025
@dongjoon-hyun dongjoon-hyun marked this pull request as ready for review August 9, 2025 13:42
@dongjoon-hyun dongjoon-hyun marked this pull request as draft August 9, 2025 14:02
@dongjoon-hyun
Copy link
Member Author

Oh, it's tricky because we need Java 17 and Java 21 distribution separately. Let me close this for now.

This release leverages the new Java Foreign Function & Memory (FFM) API capability (JEP 412), which is in incubation in Java 17. This means that Java 17 is required to compile this code and at runtime. The location of the FFM code was moved from jdk.incubator.foreign in Java 17 to its position for preview in Java 21 at java.base/java.lang.foreign. As a result, code compiled with Java 17 FFM will not run with Java 21, the next LTS. Java does not provide backward compatibility for older incubation code.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-53225 branch November 16, 2025 16:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant