Pipeline/stack build logbook

[chartgerink]

These are the various pieces of software needed in the stack. I am trying to independently build and run these (running should be no difficulty if jar file is provided). It seems like there are problems in the github POMs; pdf2svg and svg2xml do not build at all on my machine.

Build

1. euclid
   a. No success building from Github clone; see errors here
   b. Success when cloning from wwmm/euclid on Bitbucket

2. svg
   a. No success building from Github clone; see errors here
   b. Success when building from bitbucket clone from wwmm/svg on Bitbucket

3. html
   a. No success building from Github clone; see errors here
   b. Success when building from bitbucket clone from wwmm/html on Bitbucket

4. imageanalysis
   a. No success building from Github clone; see errors here
   b. Success when building from bitbucket clone from petermr/imageanalysis on Bitbucket

5. pdf2svg
   a. No success building from Github clone; see errors here
   b. Failure building from bitbucket clone from petermr/pdf2svg on Bitbucket; see errors here

6. svg2xml
   a. No success building from Github clone; see errors here
   b. Failure when building from bitbucket clone from petermr/svg2xml on Bitbucket; see errors here

JAR files download

This needs updating. @petermr: what jars do we need to run the pipeline? Not all, I figure, so please remove (and add) as you see fit.

1. euclid
2. svg
3. html
4. imageanalysis
5. pdf2svg
6. svg2xml

[petermr]

Many thanks, The Github failures are because we didn't get the Parent POM correct. Tom and I discussed this and we thought it would be OK. I'll look in the morning. The Bitbucket fails I am not sure about. the tests seem to run. To run the pipeline we only need one jar - svg2xml jar-including-dependencies. We could put an entry point for pdf2svg if we want it.

…

On Sat, Feb 4, 2017 at 1:44 PM, Chris Hartgerink ***@***.***> wrote: These are the various pieces of software needed in the stack. I am trying to independently build and run these (running should be no difficulty if jar file is provided). It seems like there are problems in the github POMs; pdf2svg and svg2xml do not build at all on my machine. Build 1. euclid a. No success building from Github <https://github.com/contentmine/euclid> clone; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/euclid.txt> b. Success when cloning from wwmm/euclid on Bitbucket <https://bitbucket.org/wwmm/euclid> 2. svg a. No success building from Github <https://github.com/contentmine/svg> clone; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/svg.txt> b. Success when building from bitbucket clone from wwmm/svg on Bitbucket <https://bitbucket.org/wwmm/svg> 3. html a. No success building from Github <https://github.com/contentmine/html> clone; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/html.txt> b. Success when building from bitbucket clone from wwmm/html on Bitbucket <https://bitbucket.org/wwmm/html> 4. imageanalysis a. No success building from Github <https://github.com/contentmine/imageanalysis> clone; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/imageanalysis.txt> b. Success when building from bitbucket clone from petermr/imageanalysis on Bitbucket <https://bitbucket.org/petermr/imageanalysis> 5. pdf2svg a. No success building from Github <https://github.com/contentmine/pdf2svg> clone; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/pdf2svg.txt> b. Failure building from bitbucket clone from petermr/pdf2svg on Bitbucket <https://bitbucket.org/petermr/pdf2svg>; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/pdf2svg-bitbucket.txt> 6. svg2xml a. No success building from Github <https://github.com/contentmine/svg> clone; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/svg2xml.txt> b. Failure when building from bitbucket clone from petermr/svg2xml on Bitbucket <https://bitbucket.org/petermr/svg2xml>; see errors here <https://github.com/ContentMine/cm-ucl/blob/master/logs/svg2xml-bitbucket.txt> JAR files download This needs updating. @petermr <https://github.com/petermr>: what jars do we need to run the pipeline? Not all, I figure, so please remove (and add) as you see fit. 1. euclid 2. svg 3. html 4. imageanalysis 5. pdf2svg 6. svg2xml — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#18>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAsxS3eKWtC3Oh4qgc26c6AxDgwnz6ziks5rZICngaJpZM4L3J4T> .

-- Peter Murray-Rust Reader Emeritus University of Cambridge +44-1223-763069 and ContentMine Ltd

[petermr]

Suggest you comment out the parent pom in euclid/pom.xml, e.g.

<!-- 
	<parent>
		<groupId>org.contentmine</groupId>
		<artifactId>cm-parent</artifactId>
		<version>6</version>
	</parent>
-->

and rerun euclid. If that builds, rerun svg and so on down the line. I think imageanalysis might fail and I'll tackle that. I will open this as an issue on ami

[petermr]

Maven records build progress in

target/surefire-reports/%classname%.txt

Feel feel to post these

[chartgerink]

Okay great. Did as @tarrow suggested and first built the cm-pom repo. All builds up through imageanalysis succeed. So for parsimony, here is the full script that works.

git clone git@github.com:contentmine/cm-pom
git clone git@github.com:contentmine/euclid
git clone git@github.com:contentmine/svg
git clone git@github.com:contentmine/html
git clone git@github.com:contentmine/imageanalysis

cd cm-pom
mvn clean install
cd ../euclid
mvn clean install
cd ../svg
mvn clean install
cd ../html
mvn clean install
cd ../imageanalysis
mvn clean install

I've attached the logs for pdf2svg and here is the error code. Didn't try to build svg2xml because this failed.

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:26 min
[INFO] Finished at: 2017-02-06T19:39:52+01:00
[INFO] Final Memory: 43M/726M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.16:integration-test (default) on project pdf2svg: Execution default of goal org.apache.maven.plugins:maven-failsafe-plugin:2.16:integration-test failed: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ?
[ERROR] Command was/bin/sh -c cd /home/chjh/cm-build/pdf2svg && /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.121-1.b14.fc25.x86_64/jre/bin/java -jar /home/chjh/cm-build/pdf2svg/target/surefire/surefirebooter1010859818501399092.jar /home/chjh/cm-build/pdf2svg/target/surefire/surefire1411116778717291752tmp /home/chjh/cm-build/pdf2svg/target/surefire/surefire_01118037285889469735tmp
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException

test-pdf2svg-fail.zip

[petermr]

poms should now be fixed. Closing issues and opening one on JAR files

[chartgerink]

This will be solved with issue #19. See cm-pom for building scripts if in need (not relevant per se to this project anymore, just for testing purposes).