Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RestTest Failures #11046

Closed
hasancelik opened this issue Aug 7, 2017 · 9 comments

Comments

Projects
None yet
6 participants
@hasancelik
Copy link
Contributor

commented Aug 7, 2017

testMap_PutGet_withLargeValue_chunked
testMap_PutGet_withLargeKey_chunked
testMapPutGet_chunked

java.io.IOException: Invalid Http response
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1588)
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
	at com.hazelcast.internal.ascii.HTTPCommunicator.doGet(HTTPCommunicator.java:226)
	at com.hazelcast.internal.ascii.HTTPCommunicator.mapGet(HTTPCommunicator.java:69)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeValue0(RestTest.java:263)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeValue_chunked(RestTest.java:247)

https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-OracleJDK8/1261/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-OracleJDK8/1263/

https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-ZuluJDK8/658/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-ZuluJDK8/660/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-ZuluJDK8/654/

https://hazelcast-l337.ci.cloudbees.com/view/Sonar/job/Hazelcast-3.x-sonar/1585/

@devOpsHazelcast

This comment has been minimized.

Copy link
Contributor

commented Aug 14, 2017

testMapPutGet_chunked
testMap_PutGet_withLargeKey_chunked

org.junit.runners.model.TestTimedOutException: test timed out after 300000 milliseconds
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:129)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
	at java.io.FilterInputStream.read(FilterInputStream.java:116)
	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:2707)
	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:2702)
	at com.hazelcast.internal.ascii.HTTPCommunicator.doGet(HTTPCommunicator.java:230)
	at com.hazelcast.internal.ascii.HTTPCommunicator.mapGet(HTTPCommunicator.java:69)
	at com.hazelcast.internal.ascii.RestTest.testMapPutGet0(RestTest.java:126)
	at com.hazelcast.internal.ascii.RestTest.testMapPutGet_chunked(RestTest.java:116)

https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-freestyle/834/testReport/junit/com.hazelcast.internal.ascii/RestTest/testMapPutGet_chunked/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-freestyle/831/testReport/junit/com.hazelcast.internal.ascii/RestTest/testMap_PutGet_withLargeKey_chunked/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-IbmJDK1.7/1372/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-IbmJDK1.8/682/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-IbmJDK1.8/683/#showFailuresLink
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-OracleJDK1.6-freestyle/196/testReport/junit/com.hazelcast.internal.ascii/RestTest/testMapPutGet_chunked/
https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-OracleJDK8/1270/

@hasancelik

This comment has been minimized.

Copy link
Contributor Author

commented Aug 14, 2017

maintenance

org.junit.runners.model.TestTimedOutException: test timed out after 300000 milliseconds
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:129)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
	at java.io.FilterInputStream.read(FilterInputStream.java:116)
	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:2707)
	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:2702)
	at com.hazelcast.internal.ascii.HTTPCommunicator.doGet(HTTPCommunicator.java:233)
	at com.hazelcast.internal.ascii.HTTPCommunicator.mapGet(HTTPCommunicator.java:73)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeKey0(RestTest.java:276)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeKey_chunked(RestTest.java:262)

https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast%20Maintenance/job/Hazelcast-3.maintenance-freestyle/196/testReport/junit/com.hazelcast.internal.ascii/RestTest/testMap_PutGet_withLargeKey_chunked/

https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast%20Maintenance/job/Hazelcast-3.maintenance-freestyle/200/

@ahmetmircik ahmetmircik self-assigned this Aug 14, 2017

@ahmetmircik

This comment has been minimized.

Copy link
Member

commented Aug 14, 2017

merged a fix-attempt: 6c4e3ad

@Donnerbart

This comment has been minimized.

Copy link
Contributor

commented Aug 16, 2017

Failed again on a local test run.

testMap_PutGet_withLargeValue_chunked()

java.io.IOException: Invalid Http response

	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1588)
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
	at com.hazelcast.internal.ascii.HTTPCommunicator.doGet(HTTPCommunicator.java:240)
	at com.hazelcast.internal.ascii.HTTPCommunicator.mapGet(HTTPCommunicator.java:73)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeValue0(RestTest.java:264)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeValue_chunked(RestTest.java:248)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at com.hazelcast.test.FailOnTimeoutStatement$CallableStatement.call(FailOnTimeoutStatement.java:105)
	at com.hazelcast.test.FailOnTimeoutStatement$CallableStatement.call(FailOnTimeoutStatement.java:97)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.lang.Thread.run(Thread.java:748)

@Donnerbart Donnerbart reopened this Aug 16, 2017

@Donnerbart

This comment has been minimized.

Copy link
Contributor

commented Aug 17, 2017

Also failed on Jenkins:
com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeValue_chunked

java.io.IOException: Invalid Http response
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1588)
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
	at com.hazelcast.internal.ascii.HTTPCommunicator.doGet(HTTPCommunicator.java:240)
	at com.hazelcast.internal.ascii.HTTPCommunicator.mapGet(HTTPCommunicator.java:73)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeValue0(RestTest.java:264)
	at com.hazelcast.internal.ascii.RestTest.testMap_PutGet_withLargeValue_chunked(RestTest.java:248)

https://hazelcast-l337.ci.cloudbees.com/view/Sonar/job/Hazelcast-3.x-sonar/lastCompletedBuild/com.hazelcast$hazelcast/testReport/com.hazelcast.internal.ascii/RestTest/testMap_PutGet_withLargeValue_chunked/

@hasancelik

This comment has been minimized.

Copy link
Contributor Author

commented Aug 21, 2017

testMapPutGet_chunked

java.io.IOException: Invalid Http response
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1343)
	at com.hazelcast.internal.ascii.HTTPCommunicator.doGet(HTTPCommunicator.java:240)
	at com.hazelcast.internal.ascii.HTTPCommunicator.mapGet(HTTPCommunicator.java:73)
	at com.hazelcast.internal.ascii.RestTest.testMapPutGet0(RestTest.java:127)
	at com.hazelcast.internal.ascii.RestTest.testMapPutGet_chunked(RestTest.java:117)

https://hazelcast-l337.ci.cloudbees.com/view/Hazelcast/job/Hazelcast-3.x-nightly/com.hazelcast$hazelcast/1445/testReport/junit/com.hazelcast.internal.ascii/RestTest/testMapPutGet_chunked/

@mesutcelik

This comment has been minimized.

Copy link
Contributor

commented Aug 23, 2017

I tried to reproduce this by repeating tests but no success. It looks like response returned by hazelcast is malformed. I was able to reproduce the same exception by playing with response byte array.

The only pattern I see from above exceptions is first a PUT then GET called and GET response is malformed.

@mdogan

This comment has been minimized.

Copy link
Member

commented Aug 24, 2017

I'm able to reproduce on a Linux machine. I've tried to analyze the packets using Wireshark. But it shows http response as valid.
One solution might be to drop our http server and replace it with a real one.

@mdogan

This comment has been minimized.

Copy link
Member

commented Aug 24, 2017

Converted RestTest to use Apache HttpClient: #11213

@mdogan mdogan closed this Aug 24, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.