Skip to content

Commit

Permalink
Create README.rst
Browse files Browse the repository at this point in the history
  • Loading branch information
lee212 committed Jun 29, 2018
1 parent 6a086de commit 44ddf82
Showing 1 changed file with 83 additions and 0 deletions.
83 changes: 83 additions & 0 deletions README.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,83 @@
Big Data Benchmark: Running Big Data Workloads on Bare Metal Clouds, Oracle and Amazon
======================================================================================

Preprint: DOI: 10.13140/RG.2.2.12204.36486 `researchgate <https://www.researchgate.net/publication/325498880_Big_Data_Benchmarks_on_Bare_Metal_Cloud>`_

Bare Metal Comparison
---------------------

.. figure:: docs/figures/oci_aws.png
:align: left
.. figure:: docs/figures/oci_aws_2.png
:align: right

Report Data
^^^^^^^^^^^^

`AWS <bench/aws.i3.metal/1t32000iops/hibench.report>`_
`OCI <bench/oci.bm.standard2.52/16t/hibench.report>`_

Server
^^^^^^^

- 1 x OCI BM.Standard2.52
- 1 x AWS i3.metal

Block Storage
^^^^^^^^^^^^^^

- OCI: 1TB with 25000IOPS
- AWS: 1TB with 32000IOPS

* mounted with xfs

HiBench 7.0
^^^^^^^^^^^

- Hadoop 2.7.5 + CDH using Docker with Centos 7 base image

``docker pull lee212/hibench-docker-cdh``

- Hadoop 3.0.1 is under development

``docker pull lee212/hadoop:3.0.1``

Data Size
"""""""""

Small, large in `micro <https://github.com/intel-hadoop/HiBench/tree/master/conf/workloads/micro>`_

Storage Comparion
---------------------

.. figure:: docs/figures/oci_io.png

Report Data
^^^^^^^^^^^^

`local NVMe <bench/oci.bm.denseio2.52/local/hibench.report.2>`_
`50g 3000IOPS <bench/oci.bm.denseio2.52/50g3000iops/hibench.report>`_
`1T 25000IOPS <bench/oci.bm.standard2.52/1t/hibench.report>`_

Server
^^^^^^^

- 1 x OCI BM.Standard2.52
- 1 x OCI BM.DenseIO2.52

Storage Options
^^^^^^^^^^^^^^^

- local NVMe
- 50G block
- 1T and 16T block

* mounted with xfs


Hadoop configuration
--------------------

`conf <docs/hadoop/conf>`_


0 comments on commit 44ddf82

Please sign in to comment.