Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple asm jars are being included in Fluo distribution #409

Closed
mikewalch opened this issue Jan 26, 2015 · 0 comments
Closed

Multiple asm jars are being included in Fluo distribution #409

mikewalch opened this issue Jan 26, 2015 · 0 comments
Labels
Milestone

Comments

@mikewalch
Copy link
Member

Fluo dependencies hadoop-yarn-client and twill-core are dependent on different version versions of asm (3.1 and 5.0.2 respectively). When both are included in the Fluo distribution tarball, the exception below can prevent Fluo from starting (during fluo yarn start) if jars are loaded in the wrong order (the one below occurred while running on Mac OS X):

Exception in thread " STARTING" java.lang.IncompatibleClassChangeError: class org.apache.twill.internal.utils.Dependencies$DependencyClassVisitor has interface org.objectweb.asm.ClassVisitor as super class
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:791)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
    at org.apache.twill.internal.utils.Dependencies.findClassDependencies(Dependencies.java:102)
    at org.apache.twill.internal.ApplicationBundler.findDependencies(ApplicationBundler.java:179)
    at org.apache.twill.internal.ApplicationBundler.createBundle(ApplicationBundler.java:136)
    at org.apache.twill.internal.ApplicationBundler.createBundle(ApplicationBundler.java:106)
    at org.apache.twill.yarn.YarnTwillPreparer.createAppMasterJar(YarnTwillPreparer.java:368)
    at org.apache.twill.yarn.YarnTwillPreparer.access$200(YarnTwillPreparer.java:106)
    at org.apache.twill.yarn.YarnTwillPreparer$1.call(YarnTwillPreparer.java:263)
    at org.apache.twill.yarn.YarnTwillPreparer$1.call(YarnTwillPreparer.java:253)
    at org.apache.twill.yarn.YarnTwillController.doStartUp(YarnTwillController.java:97)
    at org.apache.twill.internal.AbstractZKServiceController.startUp(AbstractZKServiceController.java:75)
    at org.apache.twill.internal.AbstractExecutionServiceController$ServiceDelegate.startUp(AbstractExecutionServiceController.java:109)
    at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43)
    at java.lang.Thread.run(Thread.java:722)

The 3.1 version of asm should be excluded from hadoop-yarn-client in fluo-cluster to prevent this.

@mikewalch mikewalch added the bug label Jan 26, 2015
@mikewalch mikewalch self-assigned this Jan 26, 2015
@mikewalch mikewalch added this to the 1.0.0-beta-1 milestone Jan 26, 2015
mikewalch added a commit to mikewalch/fluo that referenced this issue Jan 26, 2015
mikewalch added a commit to mikewalch/fluo that referenced this issue Jan 26, 2015
keith-turner added a commit that referenced this issue Jan 27, 2015
Fixes #409 - Multiple ASM jars in Fluo distribution can prevent Fluo fro...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant