Bash script to calculate Etag/S3 MD5 sum for very big files uploaded using multipart S3 API
Clone or download
Latest commit cae7215 Aug 2, 2016
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
LICENSE Initial commit Oct 10, 2013
README.md Fix usage section Mar 13, 2014
s3md5 Whoops, switch tabs for spaces to match. Mar 11, 2016

README.md

s3md5

Bash script to calculate Etag/S3 MD5 sum for very big files uploaded using multipart S3 API

Description

Calculates the Etag/S3 MD5 Sum of a file, using the same algorithm that S3 uses on multipart uploaded files. Specially usefull on files bigger than 5GB uploaded using multipart S3 API. You can check file integrity comparing S3 Etag with the value returns by 's3md5 file'

Usage

Usage : $APP <size> <file>

- size : Multipart chunk size in MB
- file : Calculate Etag of this file

Example

  • Use 15 MB chunk size (as default in s3cmd .s3cfg config file)

    ~> s3md5 15 myfile.dat

LICENSE

s3md5 is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

s3md5 is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with s3md5. For license details you can read LICENSE file. Also you can read GPLv3 from GNU Licenses.

AUTHOR

Copyright (C) 2013
Antonio Espinosa
Email : aespinosa at teachnova dot com
Twitter : @antespi
LinkedIn : Antonio Espinosa
Web : Teachnova