-
Notifications
You must be signed in to change notification settings - Fork 629
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ISPN-6046 Server Rolling Upgrade performance improvement #3924
Conversation
} | ||
} else { | ||
final AtomicInteger count = new AtomicInteger(0); | ||
ExecutorService executorService = Executors.newFixedThreadPool(threads); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
for consistency, use the same naming for the ExecutorService variable as above (es/executorService)
558c6b2
to
452ee9b
Compare
…he source cluster
452ee9b
to
72d0346
Compare
@ttarrant Updated. I also had to change the architecture a little bit to maintain the "advertised" performance, since |
Good job, @gustavonalle . Merged |
Brilliant work @gustavonalle 👏 |
https://issues.jboss.org/browse/ISPN-6046
https://issues.jboss.org/browse/ISPN-6052
https://issues.jboss.org/browse/ISPN-6053
https://issues.jboss.org/browse/ISPN-6064
https://issues.jboss.org/browse/ISPN-6065
Perf
Before: Rolling upgrade from clusters 8.1.0.Final (2 members) -> 8.1.0.Final (2 members)
(times are the sum of time to dump keys plus the time to synchronize data)
After: Rolling upgrade from clusters 8.2.0-SNAPSHOT (2 members) -> 8.2.0-SNAPSHOT (2 members)
(no key dump is necessary if the source cluster is ispn >= 8.0)
benchmark hardware: 8Gb RAM, 4 vCPU, Fedora 22 on Openstack
Details
This PR makes use of the Remote Iterator to migrate data between clusters, the dumpKeys step is not necessary if the source cluster has version >= 8.0. If not, it will fallback to reading keys dumped.