Guides/Scripts to work with IBM Bluemix Cloud Object Storage (S3)
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
COSrsnapshot.md
README.md
WinDuplicati.md
backup_script.sh
coscron.sh
rsnapshot.conf
rsnapshot.md
rsnapshotcron
s3cfg
windowsCommandLineCOS.md

README.md

Table of Contents

IBM Bluemix Cloud Object Storage (S3) Tools and Guides

Overview

This repository contains guides for using Open Source tools to backup Linux and Windows Servers to the IBM Bluemix Cloud Object Storage (S3) service. The IBM Bluemix Cloud Object Storage (S3) service, sometimes shortened to COS (S3), allows you to store and access your data with our resilient service. With S3 API support, cross-region resiliency, and built-in security using SecureSlice technology, Cloud Object Storage (S3) Standard allows you to create and manage buckets and provides credentials and endpoints for use with tools, applications, and gateways.

COS (S3): How it works
COS (S3): API Guide

Windows GUI Backup using Duplicati

This Windows guide uses the Open Source tool Duplicati (version 2.0) to automate backing up to the IBM Bluemix Cloud Object Storage (S3) service.

Windows Command Line Backup using Duplicati

This Windows guide shows how to use the command line version of Duplicati to backup and restore your Windows server.

Linux

The Linux guide combines rsnapshot to backup both local and remote hosts, and s3cmd to push the backups to COS (S3). There is also a KnowledgeLayer guide on how to use s3cmd to interact with your buckets.

Automated Backups in Linux

The included backup_script.sh is used to automate the process of installing and configuring s3cmd and rsnapshot for local "hot" backups and off-site "cold" backups. The script also sets up a cron job to compress the current rsnapshot backup directory every night at 10pm and push to a bucket in Cloud Object Storage (S3).

The script is broken down in to functions that I will explain here:

  • check_your_privilege: This function will check if you are root or not. If you are not root the script will assign sudo to the commands
  • set_install_variables: Determines the underlying OS so that it can set install variables
  • install_tools: Installs s3cmd, rsnapshot, rsync, and wget
  • configure_rsnapshot: Downloads our example rsnapshot.conf file and prompts you to set the directory where rsnapshot stores backups. Also downloads the rsnapshot cron file for automated backups.
  • configure_s3cmd: Downloads example s3cmd configuration file and prompts the user for their COS (S3) Access and Secret Keys as well as the COS (S3) endpoint to use. This function also creates a randomly named bucket to test that s3cmd is configured properly.
  • cos_backup_schedule: Downloads a script that will compress your rsnapshot backup directory and send it to COS (S3) using s3cmd. Function also sets up a daily cron to run that script at 10pm evey night.
  • post_install: Prints information about the install

The Script has been tested on the following operating systems:

Root Install Centos 6

Sudo Install Centos 6

Root Install Centos 7

Sudo Install Centos 7

Root install Ubuntu 16

Sudo install Ubuntu 16

Root Install Ubuntu 14

Sudo install Ubuntu 14

Root install Debian 8

Sudo install Debian 8