Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(broker): use exporter positions to calculate compactable index in snapshots #4374

Merged
merged 1 commit into from
Apr 28, 2020

Conversation

npepinpe
Copy link
Member

@npepinpe npepinpe commented Apr 24, 2020

Description

  • use concrete entry supplier in AtomixSnapshotStorageTest instead of mocks
  • use ZeebeIndexMapping and RaftLogReader directly to supply the correct Atomix entry for snapshot metadata
  • do not create a snapshot if a snapshot with that index already exists
  • add context map to stackdriver logs
  • update exported position in RecordingExporter
  • ensure log density is 1 in QA tests that require snapshotting with low synthetic loads
  • include partition in ZeebeRaftStateMachine log context

Related issues

closes #4350

Pull Request Checklist

  • All commit messages match our commit message guidelines
  • The submitting code follows our code style
  • If submitting code, please run mvn clean install -DskipTests locally before committing

… snapshots

- use concrete entry supplier in AtomixSnapshotStorageTest instead of mocks
- use ZeebeIndexMapping and RaftLogReader directly to supply the correct
  Atomix entry for snapshot metadata
- do not create a snapshot if a snapshot with that index already exists
- add context map to stackdriver logs
- update exported position in RecordingExporter
- ensure log density is 1 in QA tests that require snapshotting with low
  synthetic loads
- include partition in ZeebeRaftStateMachine log context
@npepinpe
Copy link
Member Author

bors r+

zeebe-bors bot added a commit that referenced this pull request Apr 24, 2020
4374: fix(broker): use exporter positions to calculate compactable index in snapshots r=npepinpe a=npepinpe

## Description

- use concrete entry supplier in AtomixSnapshotStorageTest instead of mocks
- use ZeebeIndexMapping and RaftLogReader directly to supply the correct Atomix entry for snapshot metadata
- do not create a snapshot if a snapshot with that index already exists
- add context map to stackdriver logs
- update exported position in RecordingExporter
- ensure log density is 1 in QA tests that require snapshotting with low synthetic loads
- include partition in ZeebeRaftStateMachine log context

## Related issues

closes #4350 

#

Co-authored-by: Deepthi Devaki Akkoorath <deepthidevaki@gmail.com>
@zeebe-bors
Copy link
Contributor

zeebe-bors bot commented Apr 24, 2020

Build failed

@npepinpe
Copy link
Member Author

bors retry

@zeebe-bors
Copy link
Contributor

zeebe-bors bot commented Apr 28, 2020

Build succeeded

@zeebe-bors zeebe-bors bot merged commit 47d5a81 into develop Apr 28, 2020
@zeebe-bors zeebe-bors bot deleted the 4350-exporter-compaction-fix branch April 28, 2020 17:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Exporter fails to recover from log after failover
2 participants