-
-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove RedisStorage
#4156
Remove RedisStorage
#4156
Conversation
Codecov Report
@@ Coverage Diff @@
## master #4156 +/- ##
==========================================
- Coverage 90.11% 89.86% -0.25%
==========================================
Files 162 161 -1
Lines 12734 12336 -398
==========================================
- Hits 11475 11086 -389
+ Misses 1259 1250 -9
📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the PR. Basically, looks good to me. I have some comments. Could you take a look?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
@knshnb Could you review this PR? |
Let me unassign knshnb-san since he is busy. @not522 Could you review this PR? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
Motivation
The implementation of RedisStorage is a bit complex and code size is large since it is based on BaseStorage. RedisStorage has been found to have bugs mainly in concurrency
set_trial_state_values
is not concurrent-safe (See Skiptest_pop_waiting_trial_thread_safe
on RedisStorage #4119).WATCH <KEY NAME>
though.)In Optuna v3.1, a brand-new Redis storage, which is based-on
JournalStorage
, is introduced. It much simpler thanRedisStorage
and improves maintainability as it is written in about 110 lines even after implemented a snapshot capability (#4102).Description of the changes
In this PR, I removed
RedisStorage
since experimental features can be removed without a deprecation process in Optuna’s development policy.