Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue 5772: (SLTS) - BaseMetadataStore does not evict entries from buffer. #5773

Conversation

sachin-j-joshi
Copy link
Contributor

Change log description
Fix bug that prevented BaseMetadataStore from evicting entries from buffer.

Purpose of the change
Fix #5772

What the code does
Fix bug that prevented BaseMetadataStore from evicting entries from buffer.

How to verify it
Test should pass.
Metrics should show entries being evicted regularly.

@codecov
Copy link

codecov bot commented Feb 21, 2021

Codecov Report

Merging #5773 (c1adb09) into master (579db02) will increase coverage by 0.46%.
The diff coverage is 100.00%.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #5773      +/-   ##
============================================
+ Coverage     84.36%   84.82%   +0.46%     
- Complexity     8990    13933    +4943     
============================================
  Files           634      918     +284     
  Lines         32831    51639   +18808     
  Branches       2986     5322    +2336     
============================================
+ Hits          27698    43803   +16105     
- Misses         3471     4948    +1477     
- Partials       1662     2888    +1226     
Impacted Files Coverage Δ Complexity Δ
.../src/main/java/io/pravega/shared/MetricsNames.java 82.35% <ø> (ø) 10.00 <0.00> (ø)
...gmentstore/storage/metadata/BaseMetadataStore.java 87.83% <100.00%> (ø) 99.00 <1.00> (?)
...store/storage/metadata/StorageMetadataMetrics.java 92.30% <100.00%> (ø) 1.00 <0.00> (?)
...ravega/client/control/impl/CancellableRequest.java 78.57% <0.00%> (-10.72%) 11.00% <0.00%> (-2.00%)
...ega/controller/store/task/ZKTaskMetadataStore.java 82.60% <0.00%> (-2.90%) 12.00% <0.00%> (ø%)
...io/pravega/common/concurrent/OrderedProcessor.java 85.71% <0.00%> (-1.79%) 15.00% <0.00%> (-1.00%)
...ga/controller/store/client/StoreClientFactory.java 79.31% <0.00%> (-1.73%) 12.00% <0.00%> (-1.00%)
...egmentstore/storage/chunklayer/ReadIndexCache.java 82.97% <0.00%> (ø) 25.00% <0.00%> (?%)
...io/pravega/segmentstore/storage/WriteSettings.java 100.00% <0.00%> (ø) 5.00% <0.00%> (?%)
...operations/CachedStreamSegmentAppendOperation.java 100.00% <0.00%> (ø) 9.00% <0.00%> (?%)
... and 285 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 579db02...c1adb09. Read the comment docs.

Signed-off-by: Sachin Joshi <sachin.joshi@emc.com>
Signed-off-by: Sachin Joshi <sachin.joshi@emc.com>
@andreipaduroiu andreipaduroiu merged commit ac83e04 into pravega:master Feb 24, 2021
sachin-j-joshi added a commit to sachin-j-joshi/pravega that referenced this pull request Feb 24, 2021
…ffer. (pravega#5773)

Fix bug that prevented BaseMetadataStore from evicting entries from buffer.

Signed-off-by: Sachin Joshi <sachin.joshi@emc.com>

Co-authored-by: Andrei Paduroiu <andreipaduroiu@users.noreply.github.com>
co-jo pushed a commit to co-jo/pravega that referenced this pull request Mar 1, 2021
…ffer. (pravega#5773)

Fix bug that prevented BaseMetadataStore from evicting entries from buffer.

Signed-off-by: Sachin Joshi <sachin.joshi@emc.com>

Co-authored-by: Andrei Paduroiu <andreipaduroiu@users.noreply.github.com>
co-jo pushed a commit to co-jo/pravega that referenced this pull request Mar 9, 2021
…ffer. (pravega#5773)

Fix bug that prevented BaseMetadataStore from evicting entries from buffer.

Signed-off-by: Sachin Joshi <sachin.joshi@emc.com>

Co-authored-by: Andrei Paduroiu <andreipaduroiu@users.noreply.github.com>
sachin-j-joshi added a commit that referenced this pull request Mar 19, 2021
Cherry-picks following changes 0.9

Issue 5518: (SLTS) Fix Integer overflow. (#5520)
Issue 5606: BoundedInputStream::markSupported() should always return false.. (#5615)
Issue 5597 : ExtendedS3ChunkStorage and ExtendedS3Storage should close S3Client. (#5598)
Issue 5535: (SegmentStore) Refactoring ExtendedS3 Test Mocks (#5537)
Issue 5456: (SLTS) - Handle possible failure during deletion of metadata keys can cause version mismatch in next attempt (#5457)
Issue 5458: (SLTS) For read operation, read all chunks in parallel. (#5459)
Issue 4967: (SLTS) Add createWithContent overload that creates object and writes to it in a single call. (#5455)
Issue 5664: SLTS - fix possible thread visibility issues.. (#5665)
Issue 5475: Eliminate unnecessary pessimistic checks. (#5662)
Issue 5570: (SLTS) AsyncBaseChunkStorage latency should not include time spent in waiting to be executed. (#5661)
Issue 4967: (SLTS) No need to check last chunk length for claimOwnership for no append mode. (#5663)
Issue 5673: (SLTS) Fix wrong GC config (#5674)
Issue 5737: (SLTS) Improve metrics (#5746)
Issue 5460: (SLTS) Add read index virtual block entries to metadata. (#5461)
Issue 5772: (SLTS) - BaseMetadataStore does not evict entries from buffer. (#5773)
Issue 5798: (SLTS) Fix close in GarbageCollector, ExtendedS3ChunkStorage and HDFSChunkStorage. (#5800)
Issue 5788: (SLTS) Remove ACL operations from ExtendedS3ChunkStorage (#5790)
Issue 5808: SLTS - Fix Preconditions checks to include enough information in message. (#5809)
Issue 5853: SLTS - BaseMetadataStore.get does not return deep copy when loading from store. #5858
Issue 5866: (SLTS) ReadIndexCache stats not reported. (#5867)


Signed-off-by: Sachin Joshi <sachin.joshi@emc.com>
@sachin-j-joshi sachin-j-joshi deleted the issue-5772-SLTS-fix-buffer-eviction branch August 23, 2021 20:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

SLTS - BaseMetadataStore does not evict entries from buffer.
2 participants