Strange errors under high concurrency with Sidekiq #80

Closed
apa512 opened this Issue Aug 14, 2014 · 3 comments

Comments

Projects
None yet
2 participants
@apa512

apa512 commented Aug 14, 2014

NoBrainer often crashes in weird ways when I'm running too many Sidekiq jobs at the same time.

Communication with the Rethink server misbehaves in one of two ways:
can't modify frozen IOError: https://gist.github.com/apa512/61321dbb81ff529fc5f0
Server dropped connection with message: "SE": https://gist.github.com/apa512/15b8fb53b086e6a0935a
Exact message varies, but basically communication with the server seems to be cut off ("SE" should be "SUCCESS").

I can't find anyone else with the same problem and I'm not even sure if to look at NoBrainer, the Rethink client or something else. Any idea what the problem could be @nviennot ?

@nviennot nviennot referenced this issue in rethinkdb/rethinkdb Aug 14, 2014

Open

Ruby driver concurrency issues #2911

@apa512

This comment has been minimized.

Show comment
Hide comment
@apa512

apa512 Aug 14, 2014

Using server version rethinkdb 1.13.3-0ubuntu1~trusty (GCC 4.8.2) and Ruby client version 1.13.0.1.

apa512 commented Aug 14, 2014

Using server version rethinkdb 1.13.3-0ubuntu1~trusty (GCC 4.8.2) and Ruby client version 1.13.0.1.

@nviennot nviennot closed this in 5281d52 Aug 15, 2014

@nviennot

This comment has been minimized.

Show comment
Hide comment
@nviennot

nviennot Aug 15, 2014

Owner

I've added a connection lock, until we get a real connection pool.
So that should fix the issue.

Owner

nviennot commented Aug 15, 2014

I've added a connection lock, until we get a real connection pool.
So that should fix the issue.

@apa512

This comment has been minimized.

Show comment
Hide comment
@apa512

apa512 Aug 15, 2014

Much appreciated.

apa512 commented Aug 15, 2014

Much appreciated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment