-
Notifications
You must be signed in to change notification settings - Fork 577
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[cloud_storage] segment_meta_cstore::materialize: revert find to lower_bound #11404
[cloud_storage] segment_meta_cstore::materialize: revert find to lower_bound #11404
Conversation
auto hint_it = _hints.find(bo); | ||
auto hint_it = _hints.lower_bound(bo); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
seems like maybe we should have a unit test for the case that caught this issue?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's difficult to model since it's just an optimization for faster lookup. I can see if there is a significant time discrepancy, but it would require some code to work as a baseline.
probably it could be easier to expose some internals to the test, maybe via a friend declaration
/ci-repeat 3 dt-repeat=3 tests/rptest/tests/offset_retention_test.py::OffsetRetentionTest.test_offset_expiration |
09080d7
to
37e9e46
Compare
force push: rebase on dev and ci run |
/ci-repeat |
https://buildkite.com/redpanda/redpanda/builds/32087#0188fe8b-7fe5-45a0-baa9-3717421e98e1 Doing a ci repeat for the offending test |
/ci-repeat 3 skip-unit dt-repeat=10 tests/rptest/tests/topic_delete_test.py::TopicDeleteCloudStorageTest.topic_delete_unavailable_test |
fix a previous wrong commit. the proper way to use the _hints vector is with lower_bound, to get an exact match or a close one, to speed up materialize. with just find, most of the call will take the slow path
37e9e46
to
94a86c9
Compare
force push: rebase on dev to check for conflicts |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
https://buildkite.com/redpanda/redpanda/builds/32265 and a new one
repeating this last one |
/ci-repeat 3 release skip-unit dt-repeat=5 tests/rptest/tests/cloud_storage_timing_stress_test.py::CloudStorageTimingStressTest.test_cloud_storage_with_partition_moves |
1 similar comment
/ci-repeat 3 release skip-unit dt-repeat=5 tests/rptest/tests/cloud_storage_timing_stress_test.py::CloudStorageTimingStressTest.test_cloud_storage_with_partition_moves |
fix a previous wrong commit.
the proper way to use the _hints vector is with lower_bound, to get an exact match or a close one, to speed up materialize. with just find, most of the call will take the slow path
Backports Required
Release Notes