Permalink
Switch branches/tags
release-1434511043 RELEASE.2018-07-13T00-09-07Z RELEASE.2018-07-10T01-42-11Z RELEASE.2018-06-29T02-11-29Z RELEASE.2018-06-22T23-48-46Z RELEASE.2018-06-09T03-43-35Z RELEASE.2018-06-08T03-49-38Z RELEASE.2018-06-07T19-10-07Z RELEASE.2018-05-25T19-49-13Z RELEASE.2018-05-16T23-35-33Z RELEASE.2018-05-11T00-29-24Z RELEASE.2018-05-10T00-00-42Z RELEASE.2018-05-04T23-13-12Z RELEASE.2018-04-27T23-33-52Z RELEASE.2018-04-19T22-54-58Z RELEASE.2018-04-12T23-41-09Z RELEASE.2018-04-04T05-20-54Z RELEASE.2018-03-30T00-38-44Z RELEASE.2018-03-28T23-45-53Z RELEASE.2018-03-19T19-22-06Z RELEASE.2018-03-16T22-52-12Z RELEASE.2018-03-12T21-25-28Z RELEASE.2018-02-09T22-40-05Z RELEASE.2018-01-18T20-33-21Z RELEASE.2018-01-02T23-07-00Z RELEASE.2017-12-28T01-21-00Z RELEASE.2017-11-22T19-55-46Z RELEASE.2017-10-27T18-59-02Z RELEASE.2017-09-29T19-16-56Z RELEASE.2017-08-05T00-00-53Z RELEASE.2017-07-24T18-27-35Z RELEASE.2017-06-13T19-01-01Z RELEASE.2017-05-05T01-14-51Z RELEASE.2017-04-29T00-40-27Z RELEASE.2017-04-25T01-27-49Z RELEASE.2017-03-16T21-50-32Z RELEASE.2017-02-16T01-47-30Z RELEASE.2017-02-15T22-55-24Z RELEASE.2017-01-25T03-14-52Z RELEASE.2016-12-13T17-19-42Z RELEASE.2016-12-12T23-44-33Z RELEASE.2016-12-12T18-35-43Z RELEASE.2016-11-26T02-23-47Z RELEASE.2016-11-24T02-09-08Z RELEASE.2016-10-24T21-23-47Z RELEASE.2016-10-22T00-50-41Z RELEASE.2016-10-14T04-00-39Z RELEASE.2016-10-07T01-16-39Z RELEASE.2016-09-11T17-42-18Z RELEASE.2016-08-21T02-44-47Z RELEASE.2016-08-16T23-19-45Z RELEASE.2016-07-13T21-46-05Z RELEASE.2016-06-03T19-32-05Z RELEASE.2016-04-17T22-09-24Z RELEASE.2016-04-14T18-38-10Z RELEASE.2016-03-21T21-08-51Z RELEASE.2016-03-11T03-45-50Z OFFICIAL.2016-02-08T00-12-28Z
Nothing to show
Find file Copy path
57 lines (35 sloc) 3.42 KB

Minio Erasure Code Quickstart Guide Slack

Minio protects data against hardware failures and silent data corruption using erasure code and checksums. With the highest level of redundancy, you may lose up to half (N/2) of the total drives and still be able to recover the data.

What is Erasure Code?

Erasure code is a mathematical algorithm to reconstruct missing or corrupted data. Minio uses Reed-Solomon code to shard objects into variable data and parity blocks. For example, in a 12 drive setup, an object can be sharded to a variable number of data and parity blocks across all the drives - ranging from six data and six parity blocks to ten data and two parity blocks.

By default, Minio shards the objects across N/2 data and N/2 parity drives. Though, you can use storage classes to use a custom configuration. We recommend N/2 data and parity blocks, as it ensures the best protection from drive failures.

In 12 drive example above, with Minio server running in the default configuration, you can lose any of the six drives and still reconstruct the data reliably from the remaining drives.

Why is Erasure Code useful?

Erasure code protects data from multiple drives failure, unlike RAID or replication. For example, RAID6 can protect against two drive failure whereas in Minio erasure code you can lose as many as half of drives and still the data remains safe. Further, Minio's erasure code is at the object level and can heal one object at a time. For RAID, healing can be done only at the volume level which translates into high downtime. As Minio encodes each object individually, it can heal objects incrementally. Storage servers once deployed should not require drive replacement or healing for the lifetime of the server. Minio's erasure coded backend is designed for operational efficiency and takes full advantage of hardware acceleration whenever available.

Erasure

What is Bit Rot protection?

Bit Rot, also known as data rot or silent data corruption is a data loss issue faced by disk drives today. Data on the drive may silently get corrupted without signaling an error has occurred, making bit rot more dangerous than a permanent hard drive failure.

Minio's erasure coded backend uses high speed HighwayHash checksums to protect against Bit Rot.

Get Started with Minio in Erasure Code

1. Prerequisites

Install Minio - Minio Quickstart Guide

2. Run Minio Server with Erasure Code

Example: Start Minio server in a 12 drives setup, using Minio binary.

minio server /data1 /data2 /data3 /data4 /data5 /data6 /data7 /data8 /data9 /data10 /data11 /data12

Example: Start Minio server in a 8 drives setup, using Minio Docker image.

docker run -p 9000:9000 --name minio \
  -v /mnt/data1:/data1 \
  -v /mnt/data2:/data2 \
  -v /mnt/data3:/data3 \
  -v /mnt/data4:/data4 \
  -v /mnt/data5:/data5 \
  -v /mnt/data6:/data6 \
  -v /mnt/data7:/data7 \
  -v /mnt/data8:/data8 \
  minio/minio server /data1 /data2 /data3 /data4 /data5 /data6 /data7 /data8

3. Test your setup

You may unplug drives randomly and continue to perform I/O on the system.