This repository has been archived by the owner on Nov 9, 2022. It is now read-only.
Speedup Bootstraping of Configuration with Large Number of Indexes #499
Labels
Milestone
Comments
|
Looking forward to the PR! |
alencruz
added a commit
to alencruz/roxy
that referenced
this issue
Jul 20, 2015
…of Indexes With a large number of indexes the bootstrapping process was taking a significant amount of time, beyond the default Roxy HTTP configuration. After looking at setup.xqy it was found that some of the index removal calls were iterating over the items instead of calling the removal function with the entire set. Similarly, some of the index creation functions were recursively adding the items instead of calling the admin function with the entire set. After looking at docs for all supported ML versions it was found that calling the functions with all items was supported. Changes were made to remove and add indexes directly. This made a large impact in the bootstrapping time for scenarios with a large number of configuration items. As a reference, in a test setup with around 1,200 configuration items the bootstrap operation was reduced from around 20 minutes to under 2 minutes with the above being the only change.
grtjn
added a commit
that referenced
this issue
Sep 21, 2015
Fixing Issue #499 Configuration with Large Number of Indexes
|
Fixed in dev |
grtjn
pushed a commit
to grtjn/roxy
that referenced
this issue
Jan 28, 2016
…of Indexes With a large number of indexes the bootstrapping process was taking a significant amount of time, beyond the default Roxy HTTP configuration. After looking at setup.xqy it was found that some of the index removal calls were iterating over the items instead of calling the removal function with the entire set. Similarly, some of the index creation functions were recursively adding the items instead of calling the admin function with the entire set. After looking at docs for all supported ML versions it was found that calling the functions with all items was supported. Changes were made to remove and add indexes directly. This made a large impact in the bootstrapping time for scenarios with a large number of configuration items. As a reference, in a test setup with around 1,200 configuration items the bootstrap operation was reduced from around 20 minutes to under 2 minutes with the above being the only change.
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
In the configuration for our project we have a large number of indexes (around 700 indexes). We were experiencing a long time for the bootstrap to complete and were running into timeout errors. The timeout errors were fixed by increasing the Roxy http parameters but the underlying cause was still present. We made some tweaks to the setup.xqy file to perform index configurations (removal and creation) at once, rather than iteratively doing each index. This speed up our bootstrapping for our scenarios by around 90% and we were able to revert back to the default Roxy http parameters. I will be making a pull request with these changes to see if it’s something the project would like to utilize.
The text was updated successfully, but these errors were encountered: