Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spurious StreamSegmentNotExistsException from WriterTableProcessor #5850

Closed
andreipaduroiu opened this issue Mar 16, 2021 · 0 comments · Fixed by #5851
Closed

Spurious StreamSegmentNotExistsException from WriterTableProcessor #5850

andreipaduroiu opened this issue Mar 16, 2021 · 0 comments · Fixed by #5851

Comments

@andreipaduroiu
Copy link
Member

Describe the bug

2021-03-15 10:39:42,842 1010918143 [core-26] ERROR i.p.s.server.writer.StorageWriter - StorageWriter[14]: Iteration[4475300].Error.
io.pravega.segmentstore.contracts.StreamSegmentNotExistsException: [Segment 'XYZ'] The StreamSegment does not exist.
        at io.pravega.segmentstore.server.containers.MetadataStore.getOrAssignSegmentId(MetadataStore.java:357)
        at io.pravega.segmentstore.server.containers.StreamSegmentContainer.forSegment(StreamSegmentContainer.java:606)
        at io.pravega.segmentstore.server.tables.ContainerTableExtensionImpl$TableWriterConnectorImpl.getSegment(ContainerTableExtensionImpl.java:563)
        at io.pravega.segmentstore.server.tables.WriterTableProcessor.flush(WriterTableProcessor.java:161)
        at io.pravega.segmentstore.server.writer.StorageWriter$ProcessorCollection.lambda$flush$0(StorageWriter.java:645)
        at java.base/java.util.stream.ReferencePipeline$3$1.accept(Unknown Source)
        at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Unknown Source)
        at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source)
        at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(Unknown Source)
        at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(Unknown Source)
        at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source)
        at java.base/java.util.stream.ReferencePipeline.collect(Unknown Source)
        at io.pravega.segmentstore.server.writer.StorageWriter$ProcessorCollection.flush(StorageWriter.java:645)
        at io.pravega.segmentstore.server.writer.StorageWriter.lambda$flush$8(StorageWriter.java:312)

To Reproduce
Happens sometimes when deleting segments. In some cases this error is logged continuously.

Expected behavior
Log at most once, then do not log again.

@andreipaduroiu andreipaduroiu self-assigned this Mar 16, 2021
sachin-j-joshi pushed a commit that referenced this issue Mar 19, 2021
Cherry-picking these PRs:

#5841: Issue #5840: (SegmentStore) Fixed a deadlock in SegmentKeyCache.
#5851: Issue #5850: (SegmentStore) Fixed a bug in WriterTableProcessor where it would attempt to flush to a deleted segment.
#5586: Issue #5581: (SegmentStore) Disabling non-essential cache inserts if cache utilization is high
#5804: Issue #5789: (SegmentStore) Improving stability during Segment Container Recoveries
#5811: Issue #5810: (SegmentStore) Fixed a StorageWriter bug that could lead to data loss
#5783: Issue #5771: (SegmentStore) Reducing the amount of heap memory used when doing Table Segment Reads.

Signed-off-by: Andrei Paduroiu <andrei.paduroiu@emc.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment