Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

rgw structures rework #11485

Merged
merged 29 commits into from Mar 9, 2017
Merged

rgw structures rework #11485

merged 29 commits into from Mar 9, 2017

Commits on Mar 9, 2017

  1. rgw: introduce rgw_pool, rgw_raw_obj 

    Pools are represented by rgw_pool (and not rgw_bucket anymore),
and we use rgw_raw_obj to reference rados objs and all 'system'
objects (vs rgw_obj that is used for rgw objects).

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    66c2b0c View commit details
    Browse the repository at this point in the history

  2. rgw: separate RGWObjState 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    10f7358 View commit details
    Browse the repository at this point in the history

  3. rgw: more fixes and adjustments following rgw_pool, rgw_raw_obj 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    5fff637 View commit details
    Browse the repository at this point in the history

  4. rgw: remove unneeded virtual declarations 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    18e8ecc View commit details
    Browse the repository at this point in the history

  5. rgw: decode rgw_raw_obj as rgw_obj when it's old object 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    3583d67 View commit details
    Browse the repository at this point in the history

  6. rgw: use rgw_raw_obj in manifest code 

    This drags in multiple related changes that are needed in order to
support that.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    81070d3 View commit details
    Browse the repository at this point in the history

  7. rgw: simple manifest compaction 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    df534b4 View commit details
    Browse the repository at this point in the history

  8. rgw: implicit rgw_bucket placement, manifest uses rgw_raw_obj 

    Two main changes here:
1. Newly created rgw_bucket does not have a predetermined placement pools
assigned to it. The placement_id param in the objects themselves points
at where the data is located. This affects object's tail location, head
is located where the bucket instance's placement rule points at.
2. Modify object manifest to use rgw_raw_obj instead of rgw_obj.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    9c1b828 View commit details
    Browse the repository at this point in the history

  9. test/rgw: extend obj, manifest unitests 

    Test rgw_raw_obj and upgrade of old rgw_obj, rgw_bucket and
old manifest.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    fc6fa2f View commit details
    Browse the repository at this point in the history

  10. rgw: fix bucket overwrite 

    got broken through the rgw_bucket cleanup related work

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    2ae6f6c View commit details
    Browse the repository at this point in the history

  11. rgw: clean rgw_obj 

    Instead of storing the oid and the name, just store the name
and calculate it when needed (same goes to locator). Also give more
coherent names to the various fields.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    bdf53ab View commit details
    Browse the repository at this point in the history

  12. rgw: add rgw_obj_index_key, kill RGWObjEnt 

    Use rgw_obj_index_key to represent entries in bucket index (typedef of
cls_rgw_obj_key). Get rid of RGWObjEnt, it was duplicate of rgw_bucket_dir_entry
anyway.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    3
    Copy the full SHA
    5cf5ab4 View commit details
    Browse the repository at this point in the history

  13. rgw: keep rgw_obj key info in rgw_obj_key field 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    50c522e View commit details
    Browse the repository at this point in the history

  14. rgw: fix ECANCELED handling in rgw_get_system_obj() 

    Fixes: http://tracker.ceph.com/issues/17996

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    e67a3b5 View commit details
    Browse the repository at this point in the history

  15. cls/version: add more useful logging 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    5f9ab9f View commit details
    Browse the repository at this point in the history

  16. rgw: move placement rule out of rgw_bucket 

    Bucket's placement rule is in the bucket instance's info. Object's
placement rule is in the manifest

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    479e9f7 View commit details
    Browse the repository at this point in the history

  17. rgw: compilation and other fixes following rebase 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    a3303c9 View commit details
    Browse the repository at this point in the history

  18. rgw: add namespace to rgw_pool 

    add a namespace field to the rgw_pool struct

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    b34208f View commit details
    Browse the repository at this point in the history

  19. rgw: handle pools namespace 

    Use rgw_pool all around, and replace librados::create_ioctx() with
helper that also sets the namespace.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    5f46b3c View commit details
    Browse the repository at this point in the history

  20. rgw: modify default pools to use namespaces 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    b21d13f View commit details
    Browse the repository at this point in the history

  21. rgw: fix async cr operation 

    Fix crash due to code cleanup. Changes scope of obj ref.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    21200e8 View commit details
    Browse the repository at this point in the history

  22. mrgw.sh: fix script 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    9fbdd2b View commit details
    Browse the repository at this point in the history

  23. rgw_admin: remove broken check 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    48dd2ce View commit details
    Browse the repository at this point in the history

  24. rgw: metadata put of bucket instance sets bucket_id 

    Need to parse the bucket id off the entry and then set it on the
bucket struct.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    2977169 View commit details
    Browse the repository at this point in the history

  25. rgw: get_obj_state() checks for empty oids 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    8310c8f View commit details
    Browse the repository at this point in the history

  26. rgw: new rest api to retrieve object layout 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    803b04e View commit details
    Browse the repository at this point in the history

  27. rgw: more fixes following rebase 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    00a2af1 View commit details
    Browse the repository at this point in the history

  28. qa/tasks/radosgw_admin: adjust test to new bucket structure 

    Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    515db13 View commit details
    Browse the repository at this point in the history

  29. rgw: fix crash when listing objects via swift 

    Fixes: http://tracker.ceph.com/issues/19249

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
    @yehudasa
    yehudasa committed Mar 9, 2017
    Copy the full SHA
    a9ec5e8 View commit details
    Browse the repository at this point in the history