This came out of code review for Timeline Server.
[https://github.com//pull/600/files#r276825586]
We need to investigate if pending compaction operation can be done in a better way so that it can easily be applied to File Stiching as well.
The current approach stems from the requirement that we have to satisfy both use-case :
1. Fetch latest file slice without any regard for pending compaction for appending
2. Fetch Merged file slices for realtime views with pending compaction factored
To avoid duplicate storage, we are doing lazy merging due to pending compaction.
JIRA info
This came out of code review for Timeline Server.
[https://github.com//pull/600/files#r276825586]
We need to investigate if pending compaction operation can be done in a better way so that it can easily be applied to File Stiching as well.
The current approach stems from the requirement that we have to satisfy both use-case :
1. Fetch latest file slice without any regard for pending compaction for appending
2. Fetch Merged file slices for realtime views with pending compaction factored
To avoid duplicate storage, we are doing lazy merging due to pending compaction.
JIRA info