Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use block.MetaFetcher in Store Gateway. #1936

Merged
merged 1 commit into from Jan 6, 2020
Merged

Conversation

bwplotka
Copy link
Member

@bwplotka bwplotka commented Jan 3, 2020

Fixes: #1874

Depends on: #1934

Changes

TODO in separate PR:

  • More observability for index-cache loading / adding: e.g duration time.

Verification

  • Unit + e2e tests.

Signed-off-by: Bartlomiej Plotka bwplotka@gmail.com

Copy link
Member

@povilasv povilasv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

small nit 👍


if err := os.MkdirAll(dir, os.ModePerm); err != nil {
return errors.Wrap(err, "create dir")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
return errors.Wrap(err, "create dir")
return errors.Wrapf(err, "create dir %s", dir)

Copy link
Member Author

@bwplotka bwplotka Jan 6, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not needed as MkdirAll error will put path inside error.

@bwplotka bwplotka changed the base branch from meta-syncer to master January 6, 2020 12:15
Fixes: #1874

* Corrupted disk cache for meta.json is handled gracefully.
* Synchronize was not taking into account deletion by removing meta.json.
* Prepare for future implementation of https://thanos.io/proposals/201901-read-write-operations-bucket.md/
* Better observability for syncronize process.
* More logs for store startup process.

TODO in separate PR:
* More observability for index-cache loading / adding time.

Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>
@bwplotka bwplotka merged commit 162e960 into master Jan 6, 2020
@bwplotka bwplotka deleted the apply-meta-syncer-store branch January 6, 2020 13:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Store gateway fails to sync block meta.json
3 participants