-
Notifications
You must be signed in to change notification settings - Fork 11
Performance Measurements with AWS S3
Christian Baun edited this page Apr 1, 2017
·
1 revision
Tested from Germany on March 30th from a Lenovo X240 Thinkpad. Internet connection was ADSL wie 16 MBps downstream and 1 MBps upstream. The services (buckets) tested were located in the US.
$ ./s3perf.sh -n 5 -s 1 -p
...
Required time to create the bucket: 1.230s
Required time to upload the files: 2.079s
Required time to download the files: 2.214s
Required time to erase the objects: 1.519s
Required time to erase the bucket: 1.719s
Required time to perform all S3-related operations: 8.761s
$ ./s3perf.sh -n 5 -s 2 -p
...
Required time to create the bucket: 1.272s
Required time to upload the files: 2.229s
Required time to download the files: 2.498s
Required time to erase the objects: 2.161s
Required time to erase the bucket: 1.176s
Required time to perform all S3-related operations: 9.336s
$ ./s3perf.sh -n 5 -s 4 -p
...
Required time to create the bucket: 1.339s
Required time to upload the files: 2.434s
Required time to download the files: 1.807s
Required time to erase the objects: 3.334s
Required time to erase the bucket: 1.322s
Required time to perform all S3-related operations: 10.236s
$ ./s3perf.sh -n 5 -s 8 -p
...
Required time to create the bucket: 1.203s
Required time to upload the files: 1.936s
Required time to download the files: 1.733s
Required time to erase the objects: 1.597s
Required time to erase the bucket: 0.944s
Required time to perform all S3-related operations: 7.413s
$ ./s3perf.sh -n 5 -s 16 -p
...
Required time to create the bucket: 1.714s
Required time to upload the files: 2.959s
Required time to download the files: 1.883s
Required time to erase the objects: 1.492s
Required time to erase the bucket: 1.084s
Required time to perform all S3-related operations: 9.132s
$ ./s3perf.sh -n 5 -s 32 -p
...
Required time to create the bucket: 1.531s
Required time to upload the files: 2.042s
Required time to download the files: 1.884s
Required time to erase the objects: 1.489s
Required time to erase the bucket: 1.020s
Required time to perform all S3-related operations: 7.966s
$ ./s3perf.sh -n 5 -s 64 -p
...
Required time to create the bucket: 1.296s
Required time to upload the files: 2.187s
Required time to download the files: 1.965s
Required time to erase the objects: 1.854s
Required time to erase the bucket: 1.195s
Required time to perform all S3-related operations: 8.497s
$ ./s3perf.sh -n 5 -s 128 -p
...
Required time to create the bucket: 1.498s
Required time to upload the files: 2.002s
Required time to download the files: 2.657s
Required time to erase the objects: 1.683s
Required time to erase the bucket: 1.524s
Required time to perform all S3-related operations: 9.364s
$ ./s3perf.sh -n 5 -s 256 -p
...
Required time to create the bucket: 1.472s
Required time to upload the files: 2.147s
Required time to download the files: 2.721s
Required time to erase the objects: 1.976s
Required time to erase the bucket: 1.933s
Required time to perform all S3-related operations: 10.249s
$ ./s3perf.sh -n 5 -s 512 -p
...
Required time to create the bucket: 1.451s
Required time to upload the files: 2.381s
Required time to download the files: 1.724s
Required time to erase the objects: 1.434s
Required time to erase the bucket: 1.265s
Required time to perform all S3-related operations: 8.255s
$ ./s3perf.sh -n 5 -s 1024 -p
...
Required time to create the bucket: 1.501s
Required time to upload the files: 2.031s
Required time to download the files: 5.488s
Required time to erase the objects: 1.784s
Required time to erase the bucket: 0.886s
Required time to perform all S3-related operations: 11.690s
$ ./s3perf.sh -n 5 -s 2048 -p
...
Required time to create the bucket: 1.650s
Required time to upload the files: 2.566s
Required time to download the files: 2.348s
Required time to erase the objects: 1.432s
Required time to erase the bucket: 1.468s
Required time to perform all S3-related operations: 9.464s
$ ./s3perf.sh -n 5 -s 4096 -p
...
Required time to create the bucket: 1.246s
Required time to upload the files: 2.100s
Required time to download the files: 2.519s
Required time to erase the objects: 1.587s
Required time to erase the bucket: 1.054s
Required time to perform all S3-related operations: 8.506s
$ ./s3perf.sh -n 5 -s 8192 -p
...
Required time to create the bucket: 1.248s
Required time to upload the files: 2.249s
Required time to download the files: 1.802s
Required time to erase the objects: 1.624s
Required time to erase the bucket: 1.067s
Required time to perform all S3-related operations: 7.990s
$ ./s3perf.sh -n 5 -s 16384 -p
...
Required time to create the bucket: 1.327s
Required time to upload the files: 2.229s
Required time to download the files: 3.415s
Required time to erase the objects: 1.597s
Required time to erase the bucket: 1.225s
Required time to perform all S3-related operations: 9.793s
$ ./s3perf.sh -n 5 -s 32768 -p
...
Required time to create the bucket: 1.688s
Required time to upload the files: 2.585s
Required time to download the files: 2.338s
Required time to erase the objects: 1.447s
Required time to erase the bucket: 0.977s
Required time to perform all S3-related operations: 9.035s
$ ./s3perf.sh -n 5 -s 65536 -p
...
Required time to create the bucket: 1.390s
Required time to upload the files: 2.608s
Required time to download the files: 2.496s
Required time to erase the objects: 2.444s
Required time to erase the bucket: 1.057s
Required time to perform all S3-related operations: 9.995s
$ ./s3perf.sh -n 5 -s 131072 -p
...
Required time to create the bucket: 1.571s
Required time to upload the files: 3.373s
Required time to download the files: 3.026s
Required time to erase the objects: 1.566s
Required time to erase the bucket: 1.474s
Required time to perform all S3-related operations: 11.010s
$ ./s3perf.sh -n 5 -s 262144 -p
...
Required time to create the bucket: 1.352s
Required time to upload the files: 4.505s
Required time to download the files: 3.442s
Required time to erase the objects: 1.674s
Required time to erase the bucket: 1.115s
Required time to perform all S3-related operations: 12.088s
$ ./s3perf.sh -n 5 -s 524288 -p
...
Required time to create the bucket: 1.468s
Required time to upload the files: 5.615s
Required time to download the files: 3.982s
Required time to erase the objects: 2.037s
Required time to erase the bucket: 1.324s
Required time to perform all S3-related operations: 14.426s
$ ./s3perf.sh -n 5 -s 1048576 -p
...
Required time to create the bucket: 1.959s
Required time to upload the files: 10.533s
Required time to download the files: 5.345s
Required time to erase the objects: 1.456s
Required time to erase the bucket: 1.162s
Required time to perform all S3-related operations: 20.455s
$ ./s3perf.sh -n 5 -s 2097152 -p
...
Required time to create the bucket: 1.635s
Required time to upload the files: 20.042s
Required time to download the files: 6.613s
Required time to erase the objects: 2.287s
Required time to erase the bucket: 2.255s
Required time to perform all S3-related operations: 32.832s
$ ./s3perf.sh -n 5 -s 4194304 -p
...
Required time to create the bucket: 1.976s
Required time to upload the files: 38.784s
Required time to download the files: 10.095s
Required time to erase the objects: 1.663s
Required time to erase the bucket: 1.137s
Required time to perform all S3-related operations: 53.655s
$ ./s3perf.sh -n 5 -s 8388608 -p
...
Required time to create the bucket: 1.452s
Required time to upload the files: 73.890s
Required time to download the files: 16.989s
Required time to erase the objects: 1.916s
Required time to erase the bucket: 1.336s
Required time to perform all S3-related operations: 95.583s
$ ./s3perf.sh -n 5 -s 16777216 -p
...
Required time to create the bucket: 1.452s
Required time to upload the files: 146.807s
Required time to download the files: 36.063s
Required time to erase the objects: 2.974s
Required time to erase the bucket: 1.582s
Required time to perform all S3-related operations: 188.878s
- Nimbus Cumulus on...
- Minio on...
- S3ninja on...
- S3rver on...
- Fake S3 on...
- Scality S3 on...
- OpenStack Swift on...
- Riak CS on...
- Measurements with s3perf and...
- Measurements with gsutil and...