Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

osd,librados: add manifest, operations for chunked object #15482

Merged
merged 9 commits into from Nov 30, 2017
Merged

osd,librados: add manifest, operations for chunked object #15482

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
e968c64
osd_types: add manifest type (chunked)
myoungwon Jun 2, 2017
bb6f5dc
osd,librados: a rados op to create chunked object
myoungwon Jun 2, 2017
7118574
osd: code to proxy read() to the chunked object.
myoungwon Jun 2, 2017
b9f9d20
osd: add promote_object() for chunked objects.
myoungwon Oct 10, 2017
61fd35f
src/test: clean up (set_redirect)
myoungwon Nov 5, 2017
54c09dd
src/test: add ChunkRead, SetChunk test
myoungwon Sep 7, 2017
93be6f7
qa/suites/rados/thrash: add set_chunk test case
myoungwon Nov 4, 2017
7353155
osd: blocking read op if object is degraded
myoungwon Nov 20, 2017
09c0348
osd: fix untracked ObjectContextRef
myoungwon Nov 22, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
9 changes: 9 additions & 0 deletions qa/suites/rados/thrash/workloads/set-chunks.yaml
View file
Open in desktop
@@ -0,0 +1,9 @@
tasks:
- rados:
clients: [client.0]
ops: 4000
objects: 300
set_chunk: true
op_weights:
chunk_read: 100
write: 30
2 changes: 2 additions & 0 deletions qa/tasks/rados.py
View file
Open in desktop
Expand Up @@ -145,6 +145,8 @@ def task(ctx, config):
args.extend(['--write-fadvise-dontneed'])
if config.get('set_redirect', False):
args.extend(['--set_redirect'])
if config.get('set_chunk', False):
args.extend(['--set_chunk'])
if config.get('pool_snaps', False):
args.extend(['--pool-snaps'])
args.extend([
Expand Down
1 change: 1 addition & 0 deletions src/include/rados.h
View file
Open in desktop
Expand Up @@ -310,6 +310,7 @@ extern int ceph_release_from_features(uint64_t features);
\
/* Extensible */ \
f(SET_REDIRECT, __CEPH_OSD_OP(WR, DATA, 39), "set-redirect") \
f(SET_CHUNK, __CEPH_OSD_OP(WR, DATA, 40), "set-chunk") \
\
/** attrs **/ \
/* read */ \
Expand Down
3 changes: 3 additions & 0 deletions src/include/rados/librados.hpp
View file
Open in desktop
Expand Up @@ -471,6 +471,9 @@ namespace librados
*/
void set_redirect(const std::string& tgt_obj, const IoCtx& tgt_ioctx,
uint64_t tgt_version);
void set_chunk(uint64_t src_offset, uint64_t src_length, const IoCtx& tgt_ioctx,
std::string tgt_oid, uint64_t tgt_offset);


friend class IoCtx;
};
Expand Down
11 changes: 11 additions & 0 deletions src/librados/librados.cc
View file
Open in desktop
Expand Up @@ -614,6 +614,17 @@ void librados::ObjectWriteOperation::set_redirect(const std::string& tgt_obj,
tgt_ioctx.io_ctx_impl->oloc, tgt_version);
}

void librados::ObjectWriteOperation::set_chunk(uint64_t src_offset,
uint64_t src_length,
const IoCtx& tgt_ioctx,
string tgt_oid,
uint64_t tgt_offset)
{
::ObjectOperation *o = &impl->o;
o->set_chunk(src_offset, src_length,
tgt_ioctx.io_ctx_impl->oloc, object_t(tgt_oid), tgt_offset);
}

void librados::ObjectWriteOperation::tmap_put(const bufferlist &bl)
{
::ObjectOperation *o = &impl->o;
Expand Down