Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

node for x86 being downloaded on ARM platform #884

Closed
MaxiBoether opened this issue Mar 5, 2020 · 5 comments
Closed

node for x86 being downloaded on ARM platform #884

MaxiBoether opened this issue Mar 5, 2020 · 5 comments

Comments

@MaxiBoether
Copy link

Do you want to request a feature or report a bug?
bug
What is the current behavior?
When running the plugin - included in hadoop - on an ARM platform, it cannot find node (even though it is installed) and downloads the x86 binary, which cannot be run on ARM.

If the current behavior is a bug, please provide the steps to reproduce.
E.g. run the Hadoop YARN compilation process on an ARM platform.

What is the expected behavior?
Downloading the correct executable.

Please mention your frontend-maven-plugin and operating system version.
version 1.6, Raspbian Buster

See log output here:
[INFO] Installing node version v8.11.3
[DEBUG] Creating install directory /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node
[DEBUG] Creating temporary directory /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
[INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x86.tar.gz to /home/hadoop/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x86.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/hadoop/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x86.tar.gz into /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-ya$
[INFO] Copying node binary from /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x86/bin/node $
[DEBUG] Deleting temporary directory /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
[INFO] Installed node locally.
[INFO] Installing Yarn version v1.7.0
[INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz to /home/hadoop/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
Mar 01, 2020 5:02:55 PM org.apache.http.client.protocol.ResponseProcessCookies processCookies
WARNING: Invalid cookie header: "Set-Cookie: _octo=GH1.1.1708147834.1583238038; Path=/; Domain=github.com; Expires=Wed, 03 Mar 2021 12:20:38 GMT; Secure". Invalid 'expires' attribute: Wed, 03 Mar 2021 12:20:38 GMT
Mar 01, 2020 5:02:55 PM org.apache.http.client.protocol.ResponseProcessCookies processCookies
WARNING: Invalid cookie header: "Set-Cookie: logged_in=no; Path=/; Domain=github.com; Expires=Wed, 03 Mar 2021 12:20:38 GMT; HttpOnly; Secure". Invalid 'expires' attribute: Wed, 03 Mar
2021 12:20:38 GMT
[DEBUG] Creating install directory /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
[INFO] Unpacking /home/hadoop/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applicati$
[DEBUG] Yarn root directory not found, checking for yarn-v1.7.0
[INFO] Installed Yarn locally.
[INFO]
[INFO] --- frontend-maven-plugin:1.6:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
[DEBUG] Configuring mojo com.github.eirslett:frontend-maven-plugin:1.6:yarn from plugin realm ClassRealm[plugin>com.github.eirslett:frontend-maven-plugin:1.6, parent: sun.misc.Launcher$AppClassLoader@14991ad]
[DEBUG] Configuring mojo 'com.github.eirslett:frontend-maven-plugin:1.6:yarn' with basic configurator -->
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-yarn-applications-catalog-webapp:3.3.0-SNAPSHOT @ /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-$

[DEBUG] (f) repositorySystemSession = org.eclipse.aether.DefaultRepositorySystemSession@d664d6
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@1b5c5e3
[DEBUG] (f) skipTests = true
[DEBUG] (f) testFailureIgnore = false
[DEBUG] (f) workingDirectory = /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
[DEBUG] (f) yarnInheritsProxyConfigFromMaven = true
[DEBUG] (f) execution = com.github.eirslett:frontend-maven-plugin:1.6:yarn {execution: yarn install}
[DEBUG] -- end configuration --
[INFO] Running 'yarn ' in /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
[DEBUG] Executing command line [/home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn/dist/bin/yarn]
[ERROR] /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node: 1: /home/hadoop/hadoop/hadoop-yarn-project/hadoop-yarn$

@hermitmmll
Copy link

hermitmmll commented Apr 28, 2020

can I help you , When I compile hadoop3.3 encounter such a problem

Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.6:install-node-and-yarn (install node and yarn) on project hadoop-yarn-applications-catalog-webapp: Could not extract the Yarn archive: Could not extract archive: '/Users/hemilk/Document/maven_repo/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz': EOFException -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.6:install-node-and-yarn (install node and yarn) on project hadoop-yarn-applications-catalog-webapp: Could not extract the Yarn archive: Could not extract archive: '/Users/hemilk/Document/maven_repo/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz'
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: Could not extract the Yarn archive: Could not extract archive: '/Users/hemilk/Document/maven_repo/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz'
at com.github.eirslett.maven.plugins.frontend.mojo.MojoUtils.toMojoFailureException (MojoUtils.java:28)
at com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute (AbstractFrontendMojo.java:103)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356)
Caused by: com.github.eirslett.maven.plugins.frontend.lib.InstallationException: Could not extract the Yarn archive
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.installYarn (YarnInstaller.java:133)
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.install (YarnInstaller.java:70)
at com.github.eirslett.maven.plugins.frontend.mojo.InstallNodeAndYarnMojo.execute (InstallNodeAndYarnMojo.java:85)
at com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute (AbstractFrontendMojo.java:94)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356)
Caused by: com.github.eirslett.maven.plugins.frontend.lib.ArchiveExtractionException: Could not extract archive: '/Users/hemilk/Document/maven_repo/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz'
at com.github.eirslett.maven.plugins.frontend.lib.DefaultArchiveExtractor.extract (ArchiveExtractor.java:131)
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.extractFile (YarnInstaller.java:148)
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.installYarn (YarnInstaller.java:125)
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.install (YarnInstaller.java:70)
at com.github.eirslett.maven.plugins.frontend.mojo.InstallNodeAndYarnMojo.execute (InstallNodeAndYarnMojo.java:85)
at com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute (AbstractFrontendMojo.java:94)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356)
Caused by: java.io.EOFException
at org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.read (GzipCompressorInputStream.java:243)
at org.apache.commons.compress.archivers.tar.TarBuffer.readBlock (TarBuffer.java:224)
at org.apache.commons.compress.archivers.tar.TarBuffer.readRecord (TarBuffer.java:195)
at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.read (TarArchiveInputStream.java:497)
at java.io.InputStream.read (InputStream.java:101)
at org.apache.commons.io.IOUtils.copyLarge (IOUtils.java:1025)
at org.apache.commons.io.IOUtils.copy (IOUtils.java:999)
at com.github.eirslett.maven.plugins.frontend.lib.DefaultArchiveExtractor.extract (ArchiveExtractor.java:119)
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.extractFile (YarnInstaller.java:148)
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.installYarn (YarnInstaller.java:125)
at com.github.eirslett.maven.plugins.frontend.lib.YarnInstaller.install (YarnInstaller.java:70)
at com.github.eirslett.maven.plugins.frontend.mojo.InstallNodeAndYarnMojo.execute (InstallNodeAndYarnMojo.java:85)
at com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute (AbstractFrontendMojo.java:94)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356)
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :hadoop-yarn-applications-catalog-webapp”

@hermitmmll
Copy link

I have solved this problem, because the size of this packet(yarn-1.7.0.tar.gz) is not the same as the actual one, caused by network problems

@areimer2
Copy link

Same issue here. The problem is unrelated to Hadoop.

The Frontend Maven Plugin, version 1.12.0, runs fine on x86_64. Now I try to build my application an Odroid-HC1.
On this machine, both uname -a and lscpu report the architecture as armv7l.

The plugin tries to download https://nodejs.org/dist/v15.11.0/node-v15.11.0-linux-x86.tar.gz, which does not exist.

@eirslett
Copy link
Owner

I suspect that the maven plugin only supports arm64. It's quite YMMV when it comes to exotic architectures.

@areimer2
Copy link

armv7l machines are not that exotic. This issue seems to be a duplicate of #715.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants