HiBench 3.0

Release date: Oct 31, 2014

We are happy to announce HiBench-3.0, a major release with lots of usability and development improvements, new features, and a number of bug fixes!

We are now supporting YARN!

Hadoop YARN is a framework for job scheduling and cluster resource management. HiBench is now supporting Hadoop YARN.

Unified MR1 and MR2 branches with different dependencies on-demand!

In this version, there won’t be two isolated working branches for MR1 and Yarn respectively. All the dependencies will be downloaded on-demand by configuring the maven configuration file. That really saves those overheads in shifting back and forth among different branches while executing your HiBench workloads.

We have new workload in HiBench

We add a sleep workload to HiBench-3.0. This helps to test the capability of the scheduler.

Benchmarks can run concurrently

Now user can configure the number of benchmarks which issue simultaneously. This scenario is very helpful to benchmark those clusters’ throughput with heavy loads.

Other Improvements

• Documentation improvements
• Various bug fixes
• Better log output
• Scripts improvements

We have verified HiBench 3.0 with some new Hadoop distribution versions, including CDH5.1.0(MRv1, MRv2), Apache Hadoop 1.0.4, Apache Hadoop 2.2.0

Contributors

The following developers contributed to this release (ordered by Github ID):

Daoyuan Wang(@adrian-wang)
Raymond Liu(@colorant)
Earnest(@Earne)
Minho Kim (@eoriented)
Jie Huang(@GraceH)
Joseph Lorenzini(@jaloren)
Jay Vyas(@jayunit100)
Jintao Guan(@jintaoguan)
Kai Wei(@kai-wei)
Qi Lv(@lvsoft)
Nishkam Ravi (@nishkamravi2)
(@pipamc)
Neo Qian(@qiansl127)
Mingfei Shi(@shimingfei)
Dong Li(@zkld123)

Thanks to everyone who contributed! We are looking forward to more contributions from every one for next release soon.