-
Notifications
You must be signed in to change notification settings - Fork 111
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding Backup/Restore capabilities. #2
Comments
I see you merged backup capabilities #14 -- Is there any documentation available about usage/how to perform backups? Thanks! |
Hey Kristin, In general we need to work on documentation, but there's a bit in the README on the requirements to make backups work. I also need to cut a release of the operator, so that you can use the backup functionality. I'll try to beef up the documentation over the next few days and also cut a release. |
Great to hear @HoustonPutman ! |
Bug/fix solr java mem not set
Are there any updates on restore functionality? @HoustonPutman |
Hey @kcmartin, sorry for the delay on this. I know backups are kind of useless without being able to restore. I think I'll be able to put some work into it early next month. Hopefully it doesn't take too long, as the workflow should basically be the opposite of the backup controller. Have y'all played around with the backup CRDs yet? Or are you waiting on the restore functionality? |
Hi @HoustonPutman, thanks, I think my teammates have experimented with the backup CRDs a bit... My plan is to wait and do more tests once the restore capability is available. :) |
@HoustonPutman
and this is in solrcloud.yaml:
It would be great if there was a nicer workaround, but I didn't find any. Does it make sense to add this to the operator? |
That makes sense to me. Does it still allow the Kube Job to copy the backup to S3 or another volume? We might have to change the runAsUser of that job as well. |
I am curious as to backup and restore options. Is there currently any viable way of backing up and restoring a collection? Either at the application level, or maybe by providing an existing PV (in my case, on AWS, I could create these from EBS snapshots, perhaps). Is "there is no current way to restore these backups" completely true? Or just that there's no method supported by this project? Does the existing backup functionality make use of https://solr.apache.org/guide/8_1/collections-api.html#backup ? In which case I could handle the restore myself by retrieving the backup (eg from S3) and making a request to the Solr API, perhaps? I'm really anxious to migrate to this project, rather than using our existing home-grown Solr chart. But for all its faults, it does allow me to quickly restore using EBS snapshots. I would like to understand any potential recovery process that exists now or might exist soon. |
The backup should work, but it is tested less than the other options. There is no way to restore that is supported by the project. You should still be able to load the backup data into the shared backup/restore PV yourself, then issue the commands to restore via the Collections API. (The operator generates the backup via that Collections API command you linked) It is possible, and there have been people that have used the backup functionality, then restored via their own methods. In Solr 9.0, there will be much easier backup/restore functionality that should work natively with S3, and won't require any intervention with the Operator. You will be able to do it entirely via Solr API commands. You can follow that progress here: https://issues.apache.org/jira/browse/SOLR-15086 |
I imagine that this would be implemented as two additional CRDs,
SolrCloudBackup
andSolrCloudRestore
.We would likely use the Solr Collections API Backup & Restore capability.
The CRDs would take as input:
Progress and completeness would be conveyed through the Status section of each CRD.
The text was updated successfully, but these errors were encountered: