Skip to content

A concurrent s3cmd tool of BUR(backup and restore) for registry ceph-rgw data.

Notifications You must be signed in to change notification settings

duyanghao/registry-rgw-BUR-tools

Repository files navigation

registry-rgw-BUR-tools

registry-rgw-BUR-tools is a concurrent s3cmd tool of BUR(backup and restore) for registry ceph-rgw data.

Introdution

Normally, we use s3cmd tool to do BUR(backup and restore) for registry rgw data, which is inefficient especially When massive data is involved because s3cmd tool is not concurrent itself.

So we need to execute s3cmd concurrently by spliting registry rgw data in order to speed up, and registry-rgw-BUR-tools helps to do this.

Prerequisites

Software

Software Version Description
s3cmd version 2.0.2 or higher Note that you need to configure s3cmd in /root/.s3cfg

Usage

  • download registry rgw data
bash start.sh download $rgw_bucket $concurrent

after download registry rgw data, you need to check for success as below:

bash registry_rgw_download_check.sh $rgw_bucket

And the result will show as below:

# bash registry_rgw_download_check.sh tmpbucket
download registry rgw blobs successfully
download registry rgw repositories successfully
  • upload registry rgw data
bash start.sh upload $rgw_bucket $concurrent

after upload registry rgw data, you need to check for success as below:

bash registry_rgw_upload_check.sh

And the result will show as below:

# bash registry_rgw_upload_check.sh 
upload registry rgw blobs successfully
upload registry rgw repositories failure

Refs

About

A concurrent s3cmd tool of BUR(backup and restore) for registry ceph-rgw data.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages