Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-44168] Add Apache Spark 3.4.1 Dockerfiles #46

Closed
wants to merge 1 commit into from

Conversation

Yikun
Copy link
Member

@Yikun Yikun commented Jun 25, 2023

What changes were proposed in this pull request?

Add Apache Spark 3.4.1 Dockerfiles.

  • Add 3.4.1 GPG key
  • Add .github/workflows/build_3.4.1.yaml
  • ./add-dockerfiles.sh 3.4.1
  • Add version and tag info

Why are the changes needed?

Apache Spark 3.4.1 released:
https://spark.apache.org/releases/spark-release-3-4-1.html

Does this PR introduce any user-facing change?

Docker image will be published.

How was this patch tested?

Add workflow and CI passed

Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
@Yikun Yikun marked this pull request as ready for review June 25, 2023 02:14
@Yikun
Copy link
Member Author

Yikun commented Jun 25, 2023

@Yikun Yikun closed this in 6f36415 Jun 25, 2023
@Yikun
Copy link
Member Author

Yikun commented Jun 25, 2023

@dongjoon-hyun Thanks, merged.

@dongjoon-hyun
Copy link
Member

Thank you!

Yikun added a commit that referenced this pull request Jun 29, 2023
### What changes were proposed in this pull request?

Change GPG key from `34F0FC5C` to `F28C9C925C188C35E345614DEDA00CE834F0FC5C` to avoid pontential collision.

The full finger print can get from below cmd:
```
$ wget https://dist.apache.org/repos/dist/dev/spark/KEYS
$ gpg --import KEYS
$ gpg --fingerprint 34F0FC5C

pub   rsa4096 2015-05-05 [SC]
      F28C 9C92 5C18 8C35 E345  614D EDA0 0CE8 34F0 FC5C
uid           [ unknown] Dongjoon Hyun (CODE SIGNING KEY) <dongjoonapache.org>
sub   rsa4096 2015-05-05 [E]

```

### Why are the changes needed?

- A short gpg key had been added as v3.4.0 gpg key in #46 .
- The short key `34F0FC5C` is from https://dist.apache.org/repos/dist/dev/spark/KEYS
- According DOI review comments, docker-library/official-images#13089 (comment) , `this should be the full key fingerprint: F28C9C925C188C35E345614DEDA00CE834F0FC5C (generating a collision for such a short key ID is trivial.`
- We'd better to switch the short key to full fingerprint

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
CI passed

Closes #50 from Yikun/gpg_key.

Authored-by: Yikun Jiang <yikunkero@gmail.com>
Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants