New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Compaction API #350
Merged
+257
−32
Merged
Compaction API #350
Changes from 1 commit
Commits
Show all changes
5 commits
Select commit
Hold shift + click to select a range
5fe3f99
Compact records based on timestamp and keep the latest one
darkdh df40ca1
Add test for compactCategory
darkdh b95ffb2
Export COMPACT_SYNC_CATEGORY
darkdh 6e945b2
Address review feedbacks
darkdh 78e8d89
Do compaction in batch with 15 seconds timeout, also support cross batch
darkdh File filter...
Filter file types
Jump to…
Jump to file
Failed to load files.
Add test for compactCategory
- Loading branch information
darkdh
committed
Oct 18, 2019
darkdh
Anthony Tseng
commit df40ca15cff0d0ba253680457f5f8eef2d424081
Verified
This commit was signed with a verified signature.
GPG key ID: E14094A20D3AAEEC
Learn about signing commits
| @@ -447,7 +447,6 @@ RequestUtil.prototype.compactRecords = function (category) { | ||
| let latestRecords = {} | ||
|
||
| let s3ObjectsToDelete = [] | ||
| const recordObjects = this.s3ObjectsToRecords(s3Objects.contents) | ||
| console.error(recordObjects) | ||
| recordObjects.forEach((recordObject) => { | ||
| const record = recordObject.record | ||
|
This conversation was marked as resolved
by AlexeyBarabash
AlexeyBarabash
Contributor
|
||
| if (latestRecords[record.objectId]) { | ||
ProTip!
Use n and p to navigate between commits in a pull request.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
this is going to keep the most recent record in each batch, which is fine, but I think we should add a comment to make that clear