forked from signalapp/Signal-Server
-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
redis.clients.jedis.exceptions.JedisConnectionException: Unexpected end of stream. #21
Comments
Possibly related: redis/jedis#932 |
Still happening and for other endpoints too, which is pretty bad for us..
|
mayfield
added a commit
to mayfield/Signal-Server
that referenced
this issue
Aug 9, 2017
Looking better, will close until it pops up again.. |
Seems to indicate that two threads are writing to Jedis at the same time…Let me see if we can synchronize access to this.
From: Justin Mayfield [mailto:notifications@github.com]
Sent: Wednesday, August 9, 2017 3:58 PM
To: ForstaLabs/TextSecure-Server <TextSecure-Server@noreply.github.com>
Cc: Christopher Williams <chriswil@codev.net>; Assign <assign@noreply.github.com>
Subject: Re: [ForstaLabs/TextSecure-Server] redis.clients.jedis.exceptions.JedisConnectionException: Unexpected end of stream. (#21)
Still happening and for other endpoints too, which is pretty bad for us..
2017-08-09T21:56:35.273828+00:00 app[web.1]: ! redis.clients.jedis.exceptions.JedisConnectionException: Unexpected end of stream.
2017-08-09T21:56:35.273830+00:00 app[web.1]: ! at redis.clients.util.RedisInputStream.ensureFill(RedisInputStream.java:199)
2017-08-09T21:56:35.273830+00:00 app[web.1]: ! at redis.clients.util.RedisInputStream.readByte(RedisInputStream.java:40)
2017-08-09T21:56:35.273831+00:00 app[web.1]: ! at redis.clients.jedis.Protocol.process(Protocol.java:151)
2017-08-09T21:56:35.273832+00:00 app[web.1]: ! at redis.clients.jedis.Protocol.read(Protocol.java:215)
2017-08-09T21:56:35.273833+00:00 app[web.1]: ! at redis.clients.jedis.Connection.readProtocolWithCheckingBroken(Connection.java:340)
2017-08-09T21:56:35.273834+00:00 app[web.1]: ! at redis.clients.jedis.Connection.getIntegerReply(Connection.java:265)
2017-08-09T21:56:35.273835+00:00 app[web.1]: ! at redis.clients.jedis.BinaryJedis.hset(BinaryJedis.java:839)
2017-08-09T21:56:35.273836+00:00 app[web.1]: ! at org.whispersystems.textsecuregcm.storage.DirectoryManager.add(DirectoryManager.java:78)
2017-08-09T21:56:35.273836+00:00 app[web.1]: ! at org.whispersystems.textsecuregcm.storage.AccountsManager.updateDirectory(AccountsManager.java:106)
2017-08-09T21:56:35.273837+00:00 app[web.1]: ! at org.whispersystems.textsecuregcm.storage.AccountsManager.update(AccountsManager.java:78)
2017-08-09T21:56:35.273837+00:00 app[web.1]: ! at org.whispersystems.textsecuregcm.controllers.DeviceController.verifyDeviceToken(DeviceController.java:179)
2017-08-09T21:56:35.273838+00:00 app[web.1]: ! at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2017-08-09T21:56:35.273838+00:00 app[web.1]: ! at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2017-08-09T21:56:35.273844+00:00 app[web.1]: ! at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2017-08-09T21:56:35.273845+00:00 app[web.1]: ! at java.lang.reflect.Method.invoke(Method.java:498)
2017-08-09T21:56:35.273846+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
2017-08-09T21:56:35.273846+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)
2017-08-09T21:56:35.273849+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205)
2017-08-09T21:56:35.273847+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)
2017-08-09T21:56:35.273850+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)
2017-08-09T21:56:35.273850+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)
2017-08-09T21:56:35.273851+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)
2017-08-09T21:56:35.273851+00:00 app[web.1]: ! at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
2017-08-09T21:56:35.273852+00:00 app[web.1]: ! at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)
2017-08-09T21:56:35.273852+00:00 app[web.1]: ! at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
2017-08-09T21:56:35.273853+00:00 app[web.1]: ! at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
2017-08-09T21:56:35.273853+00:00 app[web.1]: ! at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
2017-08-09T21:56:35.273854+00:00 app[web.1]: ! at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
2017-08-09T21:56:35.273854+00:00 app[web.1]: ! at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
2017-08-09T21:56:35.273855+00:00 app[web.1]: ! at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)
2017-08-09T21:56:35.273855+00:00 app[web.1]: ! at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)
2017-08-09T21:56:35.273856+00:00 app[web.1]: ! at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)
2017-08-09T21:56:35.273856+00:00 app[web.1]: ! at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:403)
2017-08-09T21:56:35.273857+00:00 app[web.1]: ! at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:386)
2017-08-09T21:56:35.273857+00:00 app[web.1]: ! at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:334)
2017-08-09T21:56:35.273857+00:00 app[web.1]: ! at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:221)
2017-08-09T21:56:35.273858+00:00 app[web.1]: ! at io.dropwizard.jetty.NonblockingServletHolder.handle(NonblockingServletHolder.java:49)
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub <#21 (comment)> , or mute the thread <https://github.com/notifications/unsubscribe-auth/ADV4PQiejuDnfpzpwf-3fF-GyH3qa3Dsks5sWitwgaJpZM4OuZbE> .
|
It was a timeout issue. Fixed with 722dcfd |
Oh, good then.
From: Justin Mayfield [mailto:notifications@github.com]
Sent: Thursday, August 10, 2017 10:53 AM
To: ForstaLabs/TextSecure-Server <TextSecure-Server@noreply.github.com>
Cc: Christopher Williams <chriswil@codev.net>; Mention <mention@noreply.github.com>
Subject: Re: [ForstaLabs/TextSecure-Server] redis.clients.jedis.exceptions.JedisConnectionException: Unexpected end of stream. (#21)
@chriswil-codev <https://github.com/chriswil-codev>
It was a timeout issue. Fixed with <722dcfd> 722dcfd
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub <#21 (comment)> , or mute the thread <https://github.com/notifications/unsubscribe-auth/ADV4PYgvufc-fejGCQxCl8eUGTFKKcHvks5sWzWGgaJpZM4OuZbE> .
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
In heroku I get exceptions after the server is idle for a few minutes. It looks like the redis connection is flaky or maybe the redis instance is super small and we hit conditions that jedis doesn't handle on its own. Never seen these in AWS with localhost redis, so I'm leaning towards it being an infrastructure issue.
The text was updated successfully, but these errors were encountered: