std::length_error

[kaukas]

During our batch imports redis-leveldb goes 100% CPU, not even a restart helps. Before that (or maybe unrelated - not sure) it throws a lot of these:

terminate called after throwing an instance of 'std::length_error'
  what():  basic_string::_S_create

I do not know any C/C++. How could I help debug this error?

[kaukas]

Even if it is not using 100% CPU I get a lot of random ECONNRESET, EPIPE, timeout errors in a row.

[KDr2]

@kaukas could you give me a script to reproduce this error? Then I'll try to fix it, Many thanks!

[kaukas]

I had a Ruby script pushing data using the redis gem. All it did was use mset. I can't give example data though, it's private.

[KDr2]

@kaukas

Oh, I know the reason, there is a limit of the data size in one single request, it is defined in src/rl.h:

#define READ_BUFFER 81920

Your mset request maybe too large, you can either split your request into small ones or enlarge the value of READ_BUFFER then recompile redis-leveldb, good luck.

[bitthegeek]

What operating system and on what architecture this issue happens on you?

[kaukas]

I had this issue on Ubuntu 12.04 x64.

I apologize, will not be able to provide further details since we chose to use another tool for the task.

[KDr2]

updated on #7 .