Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-7004] Switch to Travis Trusty image #4182

Merged
merged 1 commit into from Jun 28, 2017
Merged

Conversation

zentol
Copy link
Contributor

@zentol zentol commented Jun 26, 2017

Cleaned up version of #4167. With this PR we switch to the trusty image on Travis as it appears to have more stable build times.

Other changes include:

This should be merged for 1.2, 1.3 and 1.4.

@zentol
Copy link
Contributor Author

zentol commented Jun 26, 2017

huh, looks like there's a problem with hadoop2.6.5 + openjdk7. The WordCountMapreduceITCase fails for this profile, and also did so in a previous build (see #4167).

Running org.apache.flink.test.hadoop.mapreduce.WordCountMapreduceITCase
zip file closed
java.lang.IllegalStateException: zip file closed
	at java.util.zip.ZipFile.ensureOpen(ZipFile.java:634)
	at java.util.zip.ZipFile.getInputStream(ZipFile.java:347)
	at java.util.jar.JarFile.getInputStream(JarFile.java:412)
	at sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnection.java:162)
	at java.net.URLClassLoader.getResourceAsStream(URLClassLoader.java:226)
	at javax.xml.parsers.SecuritySupport$4.run(SecuritySupport.java:94)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.xml.parsers.SecuritySupport.getResourceAsStream(SecuritySupport.java:87)
	at javax.xml.parsers.FactoryFinder.findJarServiceProvider(FactoryFinder.java:283)
	at javax.xml.parsers.FactoryFinder.find(FactoryFinder.java:255)
	at javax.xml.parsers.DocumentBuilderFactory.newInstance(DocumentBuilderFactory.java:121)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2467)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2444)
	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2361)
	at org.apache.hadoop.conf.Configuration.get(Configuration.java:968)
	at org.apache.hadoop.mapred.JobConf.checkAndWarnDeprecation(JobConf.java:2010)
	at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:449)
	at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:187)
	at org.apache.hadoop.mapreduce.Job.getInstance(Job.java:168)
	at org.apache.flink.hadoopcompatibility.HadoopInputs.readHadoopFile(HadoopInputs.java:104)
	at org.apache.flink.test.hadoop.mapreduce.WordCountMapreduceITCase.internalRun(WordCountMapreduceITCase.java:78)
	at org.apache.flink.test.hadoop.mapreduce.WordCountMapreduceITCase.testProgram(WordCountMapreduceITCase.java:67)
	at org.apache.flink.test.util.JavaProgramTestBase.testJobWithoutObjectReuse(JavaProgramTestBase.java:180)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)

.travis.yml Outdated
@@ -1,7 +1,8 @@
# s3 deployment based on http://about.travis-ci.org/blog/2012-12-18-travis-artifacts/

# send to container based infrastructure: http://docs.travis-ci.com/user/workers/container-based-infrastructure/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment is actually invalid now. Its the "SUDO-ENABLED" infra.

pom.xml Outdated
@@ -1021,6 +1021,7 @@ under the License.
<!-- Tools: watchdog -->
<exclude>tools/artifacts/**</exclude>
<exclude>tools/flink*/**</exclude>
<exclude>apache-maven-3.2.5/**</exclude>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe add a comment why this exclusion is needed.

@rmetzger
Copy link
Contributor

+1 to merge once my concerns are addressed

zentol added a commit to zentol/flink that referenced this pull request Jun 28, 2017
- enable sudo for more memory
- increase java heap size
- replace usage of oraclejdk7 since it is no longer supporter
- manually install maven 3.2.5

This closes apache#4182.
@zentol
Copy link
Contributor Author

zentol commented Jun 28, 2017

Will address issues while merging.

- enable sudo for more memory
- increase java heap size
- replace usage of oraclejdk7 since it is no longer supporter
- manually install maven 3.2.5

This closes apache#4182.
@asfgit asfgit merged commit 958d376 into apache:master Jun 28, 2017
zhenzhongxu pushed a commit to zhenzhongxu/flink that referenced this pull request Jun 30, 2017
- enable sudo for more memory
- increase java heap size
- replace usage of oraclejdk7 since it is no longer supporter
- manually install maven 3.2.5

This closes apache#4182.
@zentol zentol deleted the 7004 branch April 20, 2022 11:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants