-
Notifications
You must be signed in to change notification settings - Fork 107
A "re-imagining" of the old pbench-reindex
#3614
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
This supports deleting a datasets's indexed data and triggering re-indexing. It also provides a mechanism to globally enable or disable indexing. In the short term, this provides a workaround for our sharding issues, which are preventing us from generating useful indexing anyway, by turning it off entirely for new datasets. We can also delete indexed data (and the SQL index maps) for existing datasets and, on demand, trigger re-indexing for selected datasets.
webbnh
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. Just two thoughts/nits which I shall pre-resolve.
dbutenhof
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Interesting. I wrote two replies to your new comments, and the Review changes button shows I have 5 pending comments, so clearly I'd written previous comments I'd neglected to submit. Being lazy right now, I'm just going to submit them rather than review whether they remain relevant or even potentially interesting. 😆
This supports deleting a datasets's indexed data and triggering re-indexing. It also provides a mechanism to globally enable or disable indexing.
In the short term, this provides a workaround for our sharding issues, which are preventing us from generating useful indexing anyway, by turning it off entirely for new datasets. We can also delete indexed data (and the SQL index maps) for existing datasets and, on demand, trigger re-indexing for selected datasets.