Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HADOOP-17964. Increase Java heap size for running Maven in Dockerfile of branch-2.10. #3545

Merged
merged 1 commit into from
Oct 12, 2021

Conversation

iwasakims
Copy link
Member

https://issues.apache.org/jira/browse/HADOOP-17964

I got OOM on running create-release script in branch-2.10.

$ ./dev-support/bin/create-release --docker --dockercache
$ tail -n 14 patchprocess/mvn_install.log
---------------------------------------------------
Exception in thread "main" java.lang.OutOfMemoryError: PermGen space
        at java.util.concurrent.CopyOnWriteArrayList.iterator(CopyOnWriteArrayList.java:961)
        at org.apache.maven.cli.MavenCli.execute(MavenCli.java:877)
        at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
        at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:607)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
        at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
        at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)

I got no issue when I build the RC of 2.10.1 using the Dockerfile. JDK migration to Zulu by HADOOP-17572 might be related.

@iwasakims
Copy link
Member Author

Increasing maximum heap and perm gen size a bit worked for me.

@hadoop-yetus
Copy link

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3545/1/console in case of problems.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 23m 22s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 2m 27s Maven dependency ordering for branch
_ Patch Compile Tests _
+0 🆗 mvndep 0m 16s Maven dependency ordering for patch
+1 💚 hadolint 0m 2s There were no new hadolint issues.
+1 💚 shellcheck 0m 0s There were no new shellcheck issues.
+1 💚 shelldocs 0m 14s There were no new shelldocs issues.
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
_ Other Tests _
+1 💚 asflicense 0m 29s The patch does not generate ASF License warnings.
29m 19s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3545/1/artifact/out/Dockerfile
GITHUB PR #3545
Optional Tests dupname asflicense hadolint shellcheck shelldocs
uname Linux cae34fe48def 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / bdd396b
Max. process+thread count 52 (vs. ulimit of 5500)
modules C: U:
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3545/1/console
versions git=2.7.4 maven=3.3.9 shellcheck=0.3.7 hadolint=1.11.1-0-g0e692dd
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Copy link
Member

@aajisaka aajisaka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1. Thank you @iwasakims

@iwasakims iwasakims merged commit b8dc05e into apache:branch-2.10 Oct 12, 2021
@iwasakims
Copy link
Member Author

I merged this. Thanks, @aajisaka.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants