Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Heritrix Fails to Build from Source on 32bit Raspberry Pi 1 (missing libjnidispatch.so) #170

Closed
martinvahi opened this issue Oct 8, 2016 · 5 comments
Closed

Heritrix Fails to Build from Source on 32bit Raspberry Pi 1 (missing libjnidispatch.so) #170

martinvahi opened this issue Oct 8, 2016 · 5 comments
Labels
question

Comments

@martinvahi
Copy link 

heritrix_runner@computenode1softf1com ~/t66versioon/heritrix3 $ ls
README.md  commons  contrib  dist  engine  modules  pom.xml
heritrix_runner@computenode1softf1com ~/t66versioon/heritrix3 $ time nice -n20 mvn clean
[INFO] Scanning for projects...
[INFO] Reactor build order: 
[INFO]   Heritrix 3
[INFO]   Heritrix 3: 'commons' subproject (utility classes)
[INFO]   Heritrix 3: 'modules' subproject (reusable components)
[INFO]   Heritrix 3: 'engine' subproject
[INFO]   Heritrix 3 (distribution bundles)
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3
[INFO]    task-segment: [clean]
[INFO] ------------------------------------------------------------------------
[INFO] [clean:clean {execution: default-clean}]
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'commons' subproject (utility classes)
[INFO]    task-segment: [clean]
[INFO] ------------------------------------------------------------------------
[INFO] [clean:clean {execution: default-clean}]
[INFO] Deleting /home/heritrix_runner/t66versioon/heritrix3/commons/target
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'modules' subproject (reusable components)
[INFO]    task-segment: [clean]
[INFO] ------------------------------------------------------------------------
[INFO] [clean:clean {execution: default-clean}]
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'engine' subproject
[INFO]    task-segment: [clean]
[INFO] ------------------------------------------------------------------------
[INFO] [clean:clean {execution: default-clean}]
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3 (distribution bundles)
[INFO]    task-segment: [clean]
[INFO] ------------------------------------------------------------------------
[INFO] [clean:clean {execution: default-clean}]
[INFO] 
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] ------------------------------------------------------------------------
[INFO] Heritrix 3 ............................................ SUCCESS [1:11.151s]
[INFO] Heritrix 3: 'commons' subproject (utility classes) .... SUCCESS [36.048s]
[INFO] Heritrix 3: 'modules' subproject (reusable components)  SUCCESS [0.733s]
[INFO] Heritrix 3: 'engine' subproject ....................... SUCCESS [0.759s]
[INFO] Heritrix 3 (distribution bundles) ..................... SUCCESS [29.488s]
[INFO] ------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESSFUL
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2 minutes 32 seconds
[INFO] Finished at: Sat Oct 08 06:39:37 UTC 2016
[INFO] Final Memory: 6M/16M
[INFO] ------------------------------------------------------------------------

real    2m50.035s
user    2m43.060s
sys 0m0.950s
heritrix_runner@computenode1softf1com ~/t66versioon/heritrix3 $ sync
heritrix_runner@computenode1softf1com ~/t66versioon/heritrix3 $ time nice -n20 mvn package
[INFO] Scanning for projects...
[INFO] Reactor build order: 
[INFO]   Heritrix 3
[INFO]   Heritrix 3: 'commons' subproject (utility classes)
[INFO]   Heritrix 3: 'modules' subproject (reusable components)
[INFO]   Heritrix 3: 'engine' subproject
[INFO]   Heritrix 3 (distribution bundles)
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3
[INFO]    task-segment: [package]
[INFO] ------------------------------------------------------------------------
[INFO] [site:attach-descriptor {execution: default-attach-descriptor}]
[INFO] ------------------------------------------------------------------------
[INFO] Building Heritrix 3: 'commons' subproject (utility classes)
[INFO]    task-segment: [package]
[INFO] ------------------------------------------------------------------------
[debug] execute contextualize
[INFO] [resources:resources {execution: default-resources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[WARNING] While downloading poi:poi:2.5.1
  This artifact has been relocated to poi:poi:2.5.1-final-20040804.


[WARNING] While downloading itext:itext:1.3
  This artifact has been relocated to com.lowagie:itext:1.3.


[INFO] [compiler:compile {execution: default-compile}]
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 77 source files to /home/heritrix_runner/t66versioon/heritrix3/commons/target/classes
[WARNING] /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/bdb/KryoBinding.java:[7,63] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,28] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[WARNING] /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/bdb/AutoKryo.java:[53,67] sun.reflect.ReflectionFactory is internal proprietary API and may be removed in a future release
[INFO] /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/io/Warc2Arc.java: Some input files use or override a deprecated API.
[INFO] /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/io/Warc2Arc.java: Recompile with -Xlint:deprecation for details.
[INFO] /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java: /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java uses unchecked or unsafe operations.
[INFO] /home/heritrix_runner/t66versioon/heritrix3/commons/src/main/java/org/archive/util/TestUtils.java: Recompile with -Xlint:unchecked for details.
[debug] execute contextualize
[INFO] [resources:testResources {execution: default-testResources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
Downloading: http://download.oracle.com/maven/com/esotericsoftware/reflectasm/0.8/reflectasm-0.8.jar
[INFO] Unable to find resource 'com.esotericsoftware:reflectasm:jar:0.8' in repository download.oracle.com,maven (http://download.oracle.com/maven)
Downloading: http://builds.archive.org/maven2/com/esotericsoftware/reflectasm/0.8/reflectasm-0.8.jar
7K downloaded  (reflectasm-0.8.jar)
Downloading: http://download.oracle.com/maven/com/esotericsoftware/minlog/1.2/minlog-1.2.jar
[INFO] Unable to find resource 'com.esotericsoftware:minlog:jar:1.2' in repository download.oracle.com,maven (http://download.oracle.com/maven)
Downloading: http://builds.archive.org/maven2/com/esotericsoftware/minlog/1.2/minlog-1.2.jar
3K downloaded  (minlog-1.2.jar)
[INFO] [compiler:testCompile {execution: default-testCompile}]
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 37 source files to /home/heritrix_runner/t66versioon/heritrix3/commons/target/test-classes
[INFO] /home/heritrix_runner/t66versioon/heritrix3/commons/src/test/java/org/archive/io/arc/ARCWriterTest.java: Some input files use or override a deprecated API.
[INFO] /home/heritrix_runner/t66versioon/heritrix3/commons/src/test/java/org/archive/io/arc/ARCWriterTest.java: Recompile with -Xlint:deprecation for details.
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-plugin-api/2.0.9/maven-plugin-api-2.0.9.pom
1K downloaded  (maven-plugin-api-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven/2.0.9/maven-2.0.9.pom
18K downloaded  (maven-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/surefire-booter/2.9/surefire-booter-2.9.pom
2K downloaded  (surefire-booter-2.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/surefire-api/2.9/surefire-api-2.9.pom
2K downloaded  (surefire-api-2.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/maven-surefire-common/2.9/maven-surefire-common-2.9.pom
3K downloaded  (maven-surefire-common-2.9.pom)
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/2.1/plexus-utils-2.1.pom
3K downloaded  (plexus-utils-2.1.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-artifact/2.0.9/maven-artifact-2.0.9.pom
1K downloaded  (maven-artifact-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-project/2.0.9/maven-project-2.0.9.pom
2K downloaded  (maven-project-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-settings/2.0.9/maven-settings-2.0.9.pom
2K downloaded  (maven-settings-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-model/2.0.9/maven-model-2.0.9.pom
3K downloaded  (maven-model-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-profile/2.0.9/maven-profile-2.0.9.pom
2K downloaded  (maven-profile-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-artifact-manager/2.0.9/maven-artifact-manager-2.0.9.pom
2K downloaded  (maven-artifact-manager-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-repository-metadata/2.0.9/maven-repository-metadata-2.0.9.pom
1K downloaded  (maven-repository-metadata-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-plugin-registry/2.0.9/maven-plugin-registry-2.0.9.pom
1K downloaded  (maven-plugin-registry-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-core/2.0.9/maven-core-2.0.9.pom
7K downloaded  (maven-core-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-plugin-parameter-documenter/2.0.9/maven-plugin-parameter-documenter-2.0.9.pom
1K downloaded  (maven-plugin-parameter-documenter-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/reporting/maven-reporting-api/2.0.9/maven-reporting-api-2.0.9.pom
1K downloaded  (maven-reporting-api-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/reporting/maven-reporting/2.0.9/maven-reporting-2.0.9.pom
1K downloaded  (maven-reporting-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-error-diagnostics/2.0.9/maven-error-diagnostics-2.0.9.pom
1K downloaded  (maven-error-diagnostics-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-plugin-descriptor/2.0.9/maven-plugin-descriptor-2.0.9.pom
2K downloaded  (maven-plugin-descriptor-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-monitor/2.0.9/maven-monitor-2.0.9.pom
1K downloaded  (maven-monitor-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-toolchain/2.0.9/maven-toolchain-2.0.9.pom
3K downloaded  (maven-toolchain-2.0.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/1.3/maven-common-artifact-filters-1.3.pom
3K downloaded  (maven-common-artifact-filters-1.3.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/shared/maven-shared-components/12/maven-shared-components-12.pom
9K downloaded  (maven-shared-components-12.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/maven-parent/13/maven-parent-13.pom
22K downloaded  (maven-parent-13.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/surefire-booter/2.9/surefire-booter-2.9.jar
Downloading: http://builds.archive.org/maven2/org/codehaus/plexus/plexus-utils/2.1/plexus-utils-2.1.jar
Downloading: http://builds.archive.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/1.3/maven-common-artifact-filters-1.3.jar
32K downloaded  (surefire-booter-2.9.jar)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/surefire-api/2.9/surefire-api-2.9.jar
30K downloaded  (maven-common-artifact-filters-1.3.jar)
155K downloaded  (surefire-api-2.9.jar)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/maven-surefire-common/2.9/maven-surefire-common-2.9.jar
219K downloaded  (plexus-utils-2.1.jar)
59K downloaded  (maven-surefire-common-2.9.jar)
[INFO] [surefire:test {execution: default-test}]
[INFO] Surefire report directory: /home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/surefire-junit3/2.9/surefire-junit3-2.9.pom
1K downloaded  (surefire-junit3-2.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/surefire-providers/2.9/surefire-providers-2.9.pom
2K downloaded  (surefire-providers-2.9.pom)
Downloading: http://builds.archive.org/maven2/org/apache/maven/surefire/surefire-junit3/2.9/surefire-junit3-2.9.jar
25K downloaded  (surefire-junit3-2.9.jar)

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.archive.io.warc.WARCWriterTest
log4j:ERROR Could not create the Layout. Reported error follows.
java.lang.ClassNotFoundException: org.archive.util.OneLineSimpleLayout
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:93)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:195)
    at org.apache.log4j.helpers.Loader.loadClass(Loader.java:198)
    at org.apache.log4j.xml.DOMConfigurator.parseLayout(DOMConfigurator.java:555)
    at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:269)
    at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
    at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
    at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
    at org.apache.log4j.xml.DOMConfigurator.parseRoot(DOMConfigurator.java:492)
    at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1006)
    at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)
    at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
    at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
    at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
    at org.apache.log4j.Logger.getLogger(Logger.java:104)
    at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229)
    at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:65)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529)
    at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235)
    at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:209)
    at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:351)
    at org.archive.util.LaxHttpParser.<clinit>(LaxHttpParser.java:60)
    at org.archive.io.warc.WARCRecord.parseHeaders(WARCRecord.java:113)
    at org.archive.io.warc.WARCRecord.<init>(WARCRecord.java:90)
    at org.archive.io.warc.WARCReader.createArchiveRecord(WARCReader.java:94)
    at org.archive.io.warc.WARCReaderFactory$CompressedWARCReader$1.innerNext(WARCReaderFactory.java:290)
    at org.archive.io.ArchiveReader$ArchiveRecordIterator.exceptionNext(ArchiveReader.java:537)
    at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:495)
    at org.archive.io.ArchiveReader$ArchiveRecordIterator.next(ArchiveReader.java:436)
    at org.archive.io.ArchiveReader.validate(ArchiveReader.java:249)
    at org.archive.io.warc.WARCWriterTest.validate(WARCWriterTest.java:278)
    at org.archive.io.warc.WARCWriterTest.testWriteRecordCompressed(WARCWriterTest.java:356)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at junit.framework.TestCase.runTest(TestCase.java:164)
    at junit.framework.TestCase.runBare(TestCase.java:130)
    at junit.framework.TestResult$1.protect(TestResult.java:106)
    at junit.framework.TestResult.runProtected(TestResult.java:124)
    at junit.framework.TestResult.run(TestResult.java:109)
    at junit.framework.TestCase.run(TestCase.java:120)
    at junit.framework.TestSuite.runTest(TestSuite.java:230)
    at junit.framework.TestSuite.run(TestSuite.java:225)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
    at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
    at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
    at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
    at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
    at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
Oct 08, 2016 7:07:10 AM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/ /index.html
java.lang.IllegalArgumentException: Contains disallowed white space 0x20: http://www.archive.org/test/ /index.html
    at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:148)
    at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
    at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
    at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
    at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
    at org.archive.io.warc.WARCWriterTest.testSpaceInURL(WARCWriterTest.java:423)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at junit.framework.TestCase.runTest(TestCase.java:164)
    at junit.framework.TestCase.runBare(TestCase.java:130)
    at junit.framework.TestResult$1.protect(TestResult.java:106)
    at junit.framework.TestResult.runProtected(TestResult.java:124)
    at junit.framework.TestResult.run(TestResult.java:109)
    at junit.framework.TestCase.run(TestCase.java:120)
    at junit.framework.TestSuite.runTest(TestSuite.java:230)
    at junit.framework.TestSuite.run(TestSuite.java:225)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
    at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
    at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
    at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
    at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
    at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Oct 08, 2016 7:07:10 AM org.archive.io.warc.WARCWriter writeRecord
SEVERE: could not write record type: resourcefor URL: http://www.archive.org/test/  /index.html
java.lang.IllegalArgumentException: Contains illegal character 0x9: http://www.archive.org/test/    /index.html
    at org.archive.io.warc.WARCWriter.baseCharacterCheck(WARCWriter.java:137)
    at org.archive.io.warc.WARCWriter.checkHeaderValue(WARCWriter.java:146)
    at org.archive.io.warc.WARCWriter.createRecordHeader(WARCWriter.java:193)
    at org.archive.io.warc.WARCWriter.writeRecord(WARCWriter.java:227)
    at org.archive.io.warc.WARCWriterTest.writeRecord(WARCWriterTest.java:394)
    at org.archive.io.warc.WARCWriterTest.holeyUrl(WARCWriterTest.java:439)
    at org.archive.io.warc.WARCWriterTest.testTabInURL(WARCWriterTest.java:428)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at junit.framework.TestCase.runTest(TestCase.java:164)
    at junit.framework.TestCase.runBare(TestCase.java:130)
    at junit.framework.TestResult$1.protect(TestResult.java:106)
    at junit.framework.TestResult.runProtected(TestResult.java:124)
    at junit.framework.TestResult.run(TestResult.java:109)
    at junit.framework.TestCase.run(TestCase.java:120)
    at junit.framework.TestSuite.runTest(TestSuite.java:230)
    at junit.framework.TestSuite.run(TestSuite.java:225)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
    at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
    at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
    at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
    at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
    at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.091 sec
Running org.archive.io.BufferedSeekInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec
Running org.archive.io.RepositionableInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.042 sec
Running org.archive.io.ArchiveTest
Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec
Running org.archive.io.RecordingInputStreamTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.868 sec
Running org.archive.io.arc.ARCWriterTest
Oct 08, 2016 7:07:25 AM org.archive.util.DevUtils warnHandle
WARNING: java.lang.Throwable: Gap between expected and actual: -1
 writing arc /tmp/heritrix-junit-tests/testGapError-JUNIT.arc.gz.open
    at org.archive.io.arc.ARCWriter.write(ARCWriter.java:398)
    at org.archive.io.arc.ARCWriter.write(ARCWriter.java:357)
    at org.archive.io.arc.ARCWriterTest.testGapError(ARCWriterTest.java:522)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at junit.framework.TestCase.runTest(TestCase.java:164)
    at junit.framework.TestCase.runBare(TestCase.java:130)
    at junit.framework.TestResult$1.protect(TestResult.java:106)
    at junit.framework.TestResult.runProtected(TestResult.java:124)
    at junit.framework.TestResult.run(TestResult.java:109)
    at junit.framework.TestCase.run(TestCase.java:120)
    at junit.framework.TestSuite.runTest(TestSuite.java:230)
    at junit.framework.TestSuite.run(TestSuite.java:225)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:98)
    at org.apache.maven.surefire.junit.JUnit3Provider.executeTestSet(JUnit3Provider.java:117)
    at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:94)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
    at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
    at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
    at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.06 sec
Running org.archive.io.arc.ARCWriterPoolTest
Oct 08, 2016 7:07:50 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
Oct 08, 2016 7:07:51 AM org.archive.io.WriterPool <init>
INFO: Initial configuration: prefix=TEST, template=${prefix}-${timestamp17}-${serialno}-${heritrix.hostname}, compress=true, maxSize=100000000, maxActive=3, maxWait=100
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.979 sec
Running org.archive.io.arc.ARCReaderFactoryTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.282 sec
Running org.archive.io.ArchiveReaderFactoryTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.537 sec
Running org.archive.io.HeaderedArchiveRecordTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.143 sec
Running org.archive.io.ReplayCharSequenceTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.474 sec
Running org.archive.io.SinkHandlerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec
Running org.archive.uid.UUIDGeneratorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec
Running org.archive.settings.file.BdbModuleTest
Oct 08, 2016 7:08:34 AM org.archive.util.FilesystemLinkMaker makeHardLink
WARNING: hard links not supported on this platform - java.lang.UnsatisfiedLinkError: jnidispatch (/com/sun/jna/linux-arm/libjnidispatch.so) not found in resource path
Oct 08, 2016 7:08:34 AM org.archive.bdb.BdbModule doCheckpoint
SEVERE: unable to create required checkpoint link /tmp/heritrix-junit-tests/bdb/cp00998-20161008070830/00000000.jdb,51813
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 40.176 sec <<< FAILURE!
Running org.archive.settings.file.PrefixFinderTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.116 sec
Running org.archive.bdb.StoredQueueTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.522 sec
Running org.archive.surt.SURTTokenizerTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.984 sec
Running org.archive.util.fingerprint.LongFPSetCacheTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.55 sec
Running org.archive.util.fingerprint.MemLongFPSetTest
Oct 08, 2016 7:10:32 AM org.archive.util.fingerprint.MemLongFPSet grow
INFO: Doubling fingerprinting slots to 1024
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.946 sec
Running org.archive.util.fingerprint.ArrayLongFPCacheTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.061 sec
Running org.archive.util.LongToIntConsistentHashTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,243.576 sec
Exception in thread "ThreadedStreamConsumer" org.apache.maven.surefire.util.NestedRuntimeException: null; nested exception is org.apache.maven.surefire.report.ReporterException: Unable to create file: /home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports/TEST-org.archive.util.LongToIntConsistentHashTest.xml (No such file or directory); nested exception is java.io.FileNotFoundException: /home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports/TEST-org.archive.util.LongToIntConsistentHashTest.xml (No such file or directory)
org.apache.maven.surefire.report.ReporterException: Unable to create file: /home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports/TEST-org.archive.util.LongToIntConsistentHashTest.xml (No such file or directory); nested exception is java.io.FileNotFoundException: /home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports/TEST-org.archive.util.LongToIntConsistentHashTest.xml (No such file or directory)
java.io.FileNotFoundException: /home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports/TEST-org.archive.util.LongToIntConsistentHashTest.xml (No such file or directory)
    at java.io.FileOutputStream.open(Native Method)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:171)
    at org.apache.maven.surefire.report.XMLReporter.testSetCompleted(XMLReporter.java:123)
    at org.apache.maven.surefire.report.MulticastingReporter.testSetCompleted(MulticastingReporter.java:51)
    at org.apache.maven.surefire.report.TestSetRunListener.testSetCompleted(TestSetRunListener.java:115)
    at org.apache.maven.plugin.surefire.booterclient.output.ForkClient.consumeLine(ForkClient.java:97)
    at org.apache.maven.plugin.surefire.booterclient.output.ThreadedStreamConsumer$Pumper.run(ThreadedStreamConsumer.java:67)
    at java.lang.Thread.run(Thread.java:745)

Results :

Tests in error: 
  testDoCheckpoint(org.archive.settings.file.BdbModuleTest): Could not initialize class org.archive.util.CLibrary

Tests run: 91, Failures: 0, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] There are test failures.

Please refer to /home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports for the individual test results.
[INFO] ------------------------------------------------------------------------
[INFO] For more information, run Maven with the -e switch
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 51 minutes 24 seconds
[INFO] Finished at: Sat Oct 08 07:31:27 UTC 2016
[INFO] Final Memory: 36M/88M
[INFO] ------------------------------------------------------------------------

real    51m43.995s
user    49m36.060s
sys 0m6.720s
heritrix_runner@computenode1softf1com ~/t66versioon/heritrix3

The system:

pi@computenode1softf1com ~ $ uname -a
Linux computenode1softf1com 4.1.19+ #858 Tue Mar 15 15:52:03 GMT 2016 armv6l GNU/Linux
pi@computenode1softf1com ~ $ date
Sat Oct  8 18:30:19 UTC 2016
pi@computenode1softf1com ~ $
@nlevitt
Copy link
Contributor

nlevitt commented Oct 10, 2016

Could not initialize class org.archive.util.CLibrary
Don't see any further details about this error in the output you pasted. Can you paste
/home/heritrix_runner/t66versioon/heritrix3/commons/target/surefire-reports/org.archive.settings.file.BdbModuleTest.txt?

@anjackson
Copy link
Collaborator

CLibrary pulls in a library in order to make hard links. Looking through the log above I found:

Oct 08, 2016 7:08:34 AM org.archive.util.FilesystemLinkMaker makeHardLink
WARNING: hard links not supported on this platform - java.lang.UnsatisfiedLinkError: jnidispatch (/com/sun/jna/linux-arm/libjnidispatch.so) not found in resource path

I don't think this is actually because the file system does not support hard links. Rather, the JNA code in org.archive.util.CLibrary does not support the ARM platform.

@martinvahi
Copy link
Author

You MIGHT be able to download everything, including console output and the ~/.m2, from

http://temporary.softf1.com/2016/bugs/heritrix3_issue_170_mv_comment_02.tar.xz

The "might" part is because I'll probably delete the file after a few years.

@nlevitt
Copy link
Contributor

nlevitt commented Oct 31, 2016

@anjackson thanks for finding that. I'm skeptical of your diagnosis though... I think the error message printed probably points to the real issue:

WARNING: hard links not supported on this platform - java.lang.UnsatisfiedLinkError: jnidispatch (/com/sun/jna/linux-arm/libjnidispatch.so) not found in resource path

@martinvahi maybe this helps? http://stackoverflow.com/questions/14635999/jna-native-support-com-sun-jna-linux-arm-libjnidispatch-so-not-found-in-resou

@nlevitt
Copy link
Contributor

nlevitt commented Oct 31, 2016

Oh and btw @martinvahi the bundle you posted seems to be from a different build. A whole bunch of tests failed with "Dir /tmp/heritrix-junit-tests not writeable."

@ato ato changed the title Heritrix Fails to Build from Source on 32bit Raspberry Pi 1 Heritrix Fails to Build from Source on 32bit Raspberry Pi 1 (missing libjnidispatch.so) Aug 2, 2018
@ato ato added the bug label Aug 2, 2018
@ato ato added question and removed bug labels Mar 17, 2019
@ato ato closed this as completed Mar 17, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ato @anjackson @nlevitt @martinvahi