Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI][Java] Maven 3.9.3 causing Docker build failure #37022

Closed
zinking opened this issue Aug 4, 2023 · 4 comments · Fixed by #37119
Closed

[CI][Java] Maven 3.9.3 causing Docker build failure #37022

zinking opened this issue Aug 4, 2023 · 4 comments · Fixed by #37119
Assignees
@zinking
Labels
Component: Release Type: bug
Milestone
14.0.0

Comments

@zinking
Copy link

zinking commented Aug 4, 2023

Describe the bug, including details regarding any error messages, version, and platform.

running:

archery docker run java-jni-manylinux-2014

causing

java-jni-manylinux-201x.dockerfile:38
--------------------
  37 |     ARG maven=3.9.3
  38 | >>> RUN yum install -y java-$java-openjdk-devel && \
  39 | >>>       yum clean all && \
  40 | >>>       curl https://dlcdn.apache.org/maven/maven-3/${maven}/binaries/apache-maven-${maven}-bin.tar.gz | \
  41 | >>>         tar xfz - -C /usr/local && \
  42 | >>>       ln -s /usr/local/apache-maven-${maven}/bin/mvn /usr/local/bin
  43 |
--------------------
ERROR: failed to solve: process "/bin/bash -i -c yum install -y java-$java-openjdk-devel &&       yum clean all &&       curl https://dlcdn.apache.org/maven/maven-3/${maven}/binaries/apache-maven-${maven}-bin.tar.gz |         tar xfz - -C /usr/local &&       ln -s /usr/local/apache-maven-${maven}/bin/mvn /usr/local/bin" did not complete successfully: exit code: 2
Service 'java-jni-manylinux-2014' failed to build
Error: `docker-compose --file /root/zhenw/arrow/docker-compose.yml build --build-arg BUILDKIT_INLINE_CACHE=1 java-jni-manylinux-2014` exited with a non-zero exit code 1, see the process log above.

it seems the link for maven version 3.5.4 is no longer available

curl https://dlcdn.apache.org/maven/maven-3/3.5.4/binaries/apache-maven-3.5.4-bin.tar.gz
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL was not found on this server.</p>
</body></html>

Component(s)

Release
@zinking
Copy link
Author

zinking commented Aug 4, 2023 •
edited by kou
Loading

the maven version in .env seems 3.5.4 but the argument is actually correct.

#11 ERROR: process "/bin/bash -i -c curl https://dlcdn.apache.org/maven/maven-3/${maven}/binaries/apache-maven-${maven}-bin.tar.gz |         tar xfz - -C /usr/local" did not complete successfully: exit code: 2
------
 > [ 6/11] RUN curl https://dlcdn.apache.org/maven/maven-3/3.9.3/binaries/apache-maven-3.9.3-bin.tar.gz |         tar xfz - -C /usr/local:
^M100   196  100   196    0     0    914      0 --:--:-- --:--:-- --:--:--   911
0.493
0.493 gzip: stdin: not in gzip format
0.494 tar: Child returned status 1
0.494 tar: Error is not recoverable: exiting now

@zinking
Copy link
Author

zinking commented Aug 4, 2023

3.9.4 seems works, let me create a pr

@zinking zinking changed the title maven 3.5.4 causing docker build failure maven 3.9.3 causing docker build failure Aug 4, 2023
@github-actions github-actions bot mentioned this issue Aug 4, 2023
Closed
@kou kou changed the title maven 3.9.3 causing docker build failure [CI][Java] Maven 3.9.3 causing Docker build failure Aug 6, 2023
@zinking
Copy link
Author

zinking commented Aug 8, 2023

as discussed centos7 is not supported.

@zinking zinking closed this as completed Aug 8, 2023
@kou
Copy link
Member

kou commented Aug 11, 2023

This is also happen on Ubuntu 22.04: https://github.com/ursacomputing/crossbow/actions/runs/5818829907/job/15776016691#step:6:3163

> [3/5] RUN yum install -y java-1.8.0-openjdk-devel &&       yum clean all &&       curl https://dlcdn.apache.org/maven/maven-3/3.9.3/binaries/apache-maven-3.9.3-bin.tar.gz |         tar xfz - -C /usr/local &&       ln -s /usr/local/apache-maven-3.9.3/bin/mvn /usr/local/bin:
81.83 
81.83 Complete!
82.01 Loaded plugins: fastestmirror, ovl
82.09 Cleaning repos: base centos-sclo-rh epel extras updates
82.15 Cleaning up list of fastest mirrors
  0   196    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   196  100   196    0     0    281      0 --:--:-- --:--:-- --:--:--   281
82.87 
82.87 gzip: stdin: not in gzip format
82.87 tar: Child returned status 1
82.87 tar: Error is not recoverable: exiting now
------
java-jni-manylinux-201x.dockerfile:38
--------------------
  37 |     ARG maven=3.9.3
  38 | >>> RUN yum install -y java-$java-openjdk-devel && \
  39 | >>>       yum clean all && \
  40 | >>>       curl [https://dlcdn.apache.org/maven/maven-3/${maven}/binaries/apache-maven-${maven}-bin.tar.gz](https://dlcdn.apache.org/maven/maven-3/$%7Bmaven%7D/binaries/apache-maven-$%7Bmaven%7D-bin.tar.gz) | \
  41 | >>>         tar xfz - -C /usr/local && \
  42 | >>>       ln -s /usr/local/apache-maven-${maven}/bin/mvn /usr/local/bin
  43 |     
--------------------
ERROR: failed to solve: process "/bin/bash -i -c yum install -y java-$java-openjdk-devel &&       yum clean all &&       curl [https://dlcdn.apache.org/maven/maven-3/${maven}/binaries/apache-maven-${maven}-bin.tar.gz](https://dlcdn.apache.org/maven/maven-3/$%7Bmaven%7D/binaries/apache-maven-$%7Bmaven%7D-bin.tar.gz) |         tar xfz - -C /usr/local &&       ln -s /usr/local/apache-maven-${maven}/bin/mvn /usr/local/bin" did not complete successfully: exit code: 2
Service 'java-jni-manylinux-2014' failed to build : Build failed
Error: `docker-compose --file /home/runner/work/crossbow/crossbow/arrow/docker-compose.yml build --build-arg BUILDKIT_INLINE_CACHE=1 java-jni-manylinux-2014` exited with a non-zero exit code 1, see the process log above.

@kou kou reopened this Aug 11, 2023
kou added a commit to kou/arrow that referenced this issue Aug 11, 2023
@kou
apacheGH-37022: [CI][Java] Use the official Maven download URL
d08fc3f 
If we use https://dlcdn.apache.org/ instead of
https://www.apache.org/dyn/closer.lua , old source archived can't be
downloaded.
@github-actions github-actions bot mentioned this issue Aug 11, 2023
Merged
kou added a commit that referenced this issue Aug 11, 2023
@kou
GH-37022: [CI][Java] Use the official Maven download URL (#37119)
faf41a9 
### Rationale for this change

If we use https://dlcdn.apache.org/ instead of
https://www.apache.org/dyn/closer.lua , old source archived can't be downloaded.

### What changes are included in this PR?

Use https://www.apache.org/dyn/closer.lua .

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.
* Closes: #37022

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
@kou kou added this to the 14.0.0 milestone Aug 11, 2023
loicalleyne pushed a commit to loicalleyne/arrow that referenced this issue Nov 13, 2023
@kou @loicalleyne
apacheGH-37022: [CI][Java] Use the official Maven download URL (apach…
33e4491 
…e#37119)

### Rationale for this change

If we use https://dlcdn.apache.org/ instead of
https://www.apache.org/dyn/closer.lua , old source archived can't be downloaded.

### What changes are included in this PR?

Use https://www.apache.org/dyn/closer.lua .

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.
* Closes: apache#37022

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zinking zinking

Labels
Component: Release Type: bug
Projects
None yet
Milestone
14.0.0
2 participants
@kou @zinking