Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
Snapshot/Restore API: Snapshot checksum verification #5593
The snapshot process should verify checksums for each file that is being snapshotted to make sure that created snapshot doesn't contain corrupted files. If a corrupted file is detected, the snapshot should fail with an error.
In order to implement this feature we need to have correct and verifiable checksums stored with segment files, which is only possible for files that were written by append-only codecs. All officially supported codecs that are currently in use are append-only. If there are old 3rd party codecs that are not, such codecs will no longer work with Elasticsearch.