Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snapshot/Restore API: Snapshot checksum verification #5593

Closed
imotov opened this Issue Mar 28, 2014 · 2 comments

Comments

Projects
None yet
4 participants
@imotov
Copy link
Member

commented Mar 28, 2014

The snapshot process should verify checksums for each file that is being snapshotted to make sure that created snapshot doesn't contain corrupted files. If a corrupted file is detected, the snapshot should fail with an error.

In order to implement this feature we need to have correct and verifiable checksums stored with segment files, which is only possible for files that were written by append-only codecs. All officially supported codecs that are currently in use are append-only. If there are old 3rd party codecs that are not, such codecs will no longer work with Elasticsearch.

imotov added a commit to imotov/elasticsearch that referenced this issue Mar 28, 2014

Snapshot checksum verification
Adds automatic verification of all files that are being snapshotted. Closes elastic#5593
@kevinkluge

This comment has been minimized.

Copy link
Member

commented May 5, 2014

depends on #5924

@kevinkluge kevinkluge added v1.3.0 and removed v1.2.0 labels May 12, 2014

@clintongormley

This comment has been minimized.

Copy link
Member

commented Jul 11, 2014

@imotov are you going to able to get this in for 1.3?

@s1monw s1monw added v1.4.0 and removed v1.3.0 labels Jul 14, 2014

imotov added a commit to imotov/elasticsearch that referenced this issue Aug 20, 2014

Snapshot checksum verification
Adds automatic verification of all files that are being snapshotted. Closes elastic#5593

@imotov imotov closed this in #7159 Aug 20, 2014

imotov added a commit that referenced this issue Aug 20, 2014

Snapshot checksum verification
Adds automatic verification of all files that are being snapshotted. Closes #5593

@spinscale spinscale changed the title Snapshot checksum verification Snapshot/Restore API: Snapshot checksum verification Aug 20, 2014

@imotov imotov added the resiliency label Aug 20, 2014

imotov added a commit that referenced this issue Sep 8, 2014

Snapshot checksum verification
Adds automatic verification of all files that are being snapshotted. Closes #5593
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.