Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: Redis timeout on large multi op #1

Closed
mster opened this issue Jul 31, 2020 · 7 comments
Closed

Bug: Redis timeout on large multi op #1

mster opened this issue Jul 31, 2020 · 7 comments
Assignees
Labels
bug Something isn't working

Comments

@mster
Copy link
Owner

mster commented Jul 31, 2020

Large batch hash set crashes Redis client.

RedisError
    at RedisClient.multihset (/home/m/code/node/fireferret/lib/redis.js:151:13)
    at processTicksAndRejections (internal/process/task_queues.js:97:5)
@mster mster added the bug Something isn't working label Jul 31, 2020
@mster mster self-assigned this Jul 31, 2020
@mster
Copy link
Owner Author

mster commented Aug 1, 2020

Based on ops/sec rate limit

@mster
Copy link
Owner Author

mster commented Aug 6, 2020

OOM command not allowed when used memory > 'maxmemory'

Has to do with cache fullness.

Using Volatile-LRU eviction policy results in the above OOM error. This is because keys are removed based off the LRU algorithm's assigned timestamp.

Using Allkeys-LRU eviction policy resolves issues, as keys are removed when cache size grows.

@mster
Copy link
Owner Author

mster commented Aug 9, 2020

As eviction-policy is set and configured outside of FireFerret's control, we may only make recommendations.

A fallback method must be determined for this specific error.

@mster
Copy link
Owner Author

mster commented Aug 12, 2020

A fallback method

Still required

@mster
Copy link
Owner Author

mster commented Aug 16, 2020

Bump

@mster
Copy link
Owner Author

mster commented Aug 21, 2020

Buckets reduce the amount of operations done by Redis.

SEE: #17

@mster
Copy link
Owner Author

mster commented May 4, 2021

Closed by #17

@mster mster closed this as completed May 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant