Reef: bluestore & bluestore-rdr to Elastic Shared Blobs #52396
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
After introduction of lazy statfs updates and mechanism to store them at exit, some tests required tune-up. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Fix it, so it can be enabled and work. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Add more checks on consistency. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Upgrade local foreach_shared_blob into _fsck_foreach_shared_blob that can be used on entire BlueStore scope. Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
When we do fsck with non-repair mode, we do not get any info about shared blobs that actually were corrupted. Now we print them. Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Make faster exit when sharding not enabled. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
When reshard is applied for the first time, expand reshard range to encompas whole object. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
maybe_reshard is created to filter out unnecessary calls to request_reshard. The intended use is to let just request maybe_reshard, and delegate check if the action is really necessary to the implementation detail level. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
When encode_some fails twice ceph aborts. Now we print object details just before. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Modifed bluestore_blob_t to include current size of csum_data. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Add printing of len to operator<< for const bluestore_blob_t. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Modified TransContext. Changed std::set<SharedBlobRef> shared_blobs_written to std::set<BlobRef> blobs_written Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Move finish_write from SharedBlob to Blob. Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
This is necessary to enable adding more Buffers to Blobs that are shared. Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Adapt split_cache to new situation. Now buffers are attached to Blob, and we need always move them, regardless that we already moved relevant SharedBlob. Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Fix blobs having the same empty shared blob. Each blob on creation gets its own unique (empty) SharedBlob object. ExtentMap::dup() sometimes merges blobs together, so 2 different blobs get the same SharedBlob object. Function _do_remove() tries to convert shared blobs into regular ones. If it succeeds we could get 2 blobs having the same EMPTY SharedBlob object. The solution is to create detached SharedBlob if necessary. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
With BufferSpace now attached to Blob (was SharedBlob inside it), on-the-fly 'writing' buffers must be copied to clones. Otherwise those objects will read data from disk before it is written there. Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
WITH_ESB not defined - legacy Shared Blob handling WITH_ESB defined = BlueStore with elastic Shared Blob handling Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Add functions that can copy parts of blobs. It is necessary for merging blobs together, which happens on cloning (ExtentMap::dup). Fixed: Blob::copy_extents_over_empty was faulty when insertion was targetting last extent and that extent was invalid(empty). Add dup() for bluestore_blob_t and bluestore_blob_use_tracker. Changed: Modified Blob::copy_from for better readability. Added bluestore_blob_t::adjust_to initization that conforms to other blob specifics. Move assert for is_mutable() out of bluestore_blob_t::add_tail, so it can be used in blobs that are shared. Modify bluestore_blob_use_tracker_t::get to automatically expand when accessing more AUs then originally declared. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Two new functions: 1) can_marge_blob checks if 2 blobs are compatible to be merged together 2) merge_blob merges 2 blobs into 1, emptying source and putting all to destination Modify merge_blob() to return logical length of produced blob. Clear "unused" bitmap When make blob shared or merge it with other blob, clear unused. It drops some potential optimizations for writing into large blobs, but it is unlikely to be useful. Such info can be useful only after it reverts from Shared to regular blob. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
When we punch_hole in blobs we leave Buffers unchanged. Normally it is not a problem, but when we merge blobs there is a collision. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Introduce function that will scan through relevant range that is to be cloned, and function that will find best matching blob to attach to. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Func reblob_extents is used to modify extents. It is final step of melding 2 blobs together. It removes reference to blob that is to be phased out, and replaces it with reference to the blob that is the sum of them. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Adds function that converts a specified range in object to shared blobs, possibly merging them with other shared blobs. Modify make_range_shared_maybe_merge to allow for merging blobs. It now uses can_merge_blobs and merge_blobs. Add discard_unused_buffers() to make_range_shared. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Make ExtentMap::dup able to reuse some already existing shared blobs, when a regular blob has to be transformed to shared blob. Make ExtentMap::dup() use make_range_shared_maybe_merge a primary tool for cloning. Modify ExtentMap::dup to make a diligent merge of blobs. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Only copy Buffers that were not copied before. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Wrapped codes are a core elastic shared blob logic. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
It was possible to get srcoff and dstoff different. It is untested and error-prone. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
WITH_EXPERIMENTAL properly enabled ESB, but default #undef cleared it anyway. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Before creation of block device, write_meta() only creates dedicated file in the bluestore data dir. Moved setting "type" lower, so it will be written both to fs and to bdev label. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Just typo. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
…re-rdr Added ability to recognize both "bluestore" BlueStore and "bluestore-rdr" ceph::experimental::BlueStore. It now dynamic-casts to both types and selects the one that works. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Now 'type' is store in bdev label. It should not be artifically set. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Now ceph-kvstore-tool can operate both on bluestore and bluestore-rdr Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Move forward declaration of ZonedAllocator and ZonedFreelistManager outside of BlueStore class. It makes it always declare in top namespace. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Enable LTTNG also for bluestore-rdr. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Fixed printing derr when having "bluestore" and expecting "bluestore-rdr"; or vice versa. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
This adds the support of the objectstore 'bluestore-rdr' in ceph-volume Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
This is fixup after rebase ESB from quincy to reef. Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
|
This pull request can no longer be automatically merged: a rebase is needed and changes have to be manually resolved |
|
RADOS run I think it is ready to go. |
11 tasks
In rdr 'type' is stored in bdev label section. It can be "bluestore" or "bluestore-rdr". It is set on mkfs. But when upgrading from previous s/w version "type" is not created. Implicitly assume that non-existent "type" is "bluestore". Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
This adds the support of the --osd-id option to the raw prepare command. Fixes: https://tracker.ceph.com/issues/61995 Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is reef variant of #52077
Contribution Guidelines
To sign and title your commits, please refer to Submitting Patches to Ceph.
If you are submitting a fix for a stable branch (e.g. "pacific"), please refer to Submitting Patches to Ceph - Backports for the proper workflow.
Checklist
Show available Jenkins commands
jenkins retest this pleasejenkins test classic perfjenkins test crimson perfjenkins test signedjenkins test make checkjenkins test make check arm64jenkins test submodulesjenkins test dashboardjenkins test dashboard cephadmjenkins test apijenkins test docsjenkins render docsjenkins test ceph-volume alljenkins test ceph-volume toxjenkins test windows