Cloud WorkBench (CWB)

Quicklinks

• Write your own benchmarks with Cloud WorkBench: https://github.com/sealuzh/cwb-benchmarks
• Install CWB: https://github.com/sealuzh/cwb-chef-repo
• cwb Utility Cookbook (Chef): https://supermarket.chef.io/cookbooks/cwb
• cwb Client (RubyGem): https://github.com/sealuzh/cwb
  • Cwb::Client Docs

Literature

• Joel Scheuner, Philipp Leitner, Jürgen Cito, and Harald Gall (2014), Cloud WorkBench – Infrastructure-as-Code Based Cloud Benchmarking, in Proceedings of the 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’14), 2014. DOI: https://doi.org/10.1109/CloudCom.2014.98
• Joel Scheuner, Jürgen Cito, Philipp Leitner, and Harald Gall (2015), Cloud WorkBench: Benchmarking IaaS Providers based on Infrastructure-as-Code, in Proceedings of the 24th International World Wide Web Conference (WWW’15) – Demo Track, 2015. DOI: https://doi.org/10.1145/2740908.2742833
  • Screencast (previous version): https://youtu.be/0yGFGvHvobk?t=3m40s

Studies that Used CWB

• Joel Scheuner, Philipp Leitner (2018). Estimating Cloud Application Performance Based on Micro-Benchmark Profiling in Proceedings of the 11th IEEE International Conference on Cloud Computing (CLOUD'18).

• Christoph Laaber, Joel Scheuner, Philipp Leitner (preprint, not peer reviewed). Performance testing in the cloud. How bad is it really?

• Joel Scheuner, Philipp Leitner (2018). A Cloud Benchmark Suite Combining Micro and Applications Benchmarks, in Proceedings of the 4th International Workshop on Quality-Aware DevOps (QUDOS'17). DOI: https://doi.org/10.1145/3185768.3186286

• Christian Davatz, Christian Inzinger, Joel Scheuner, and Philipp Leitner (2017). An Approach and Case Study of Cloud Instance Type Selection for Multi-Tier Web Applications. in Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid'17). IEEE Press, Piscataway, NJ, USA, 534-543. DOI: https://doi.org/10.1109/CCGRID.2017.12

• Philipp Leitner, Jürgen Cito (2016). Patterns in the Chaos - A Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology, 16(3), pp. 15:1–15:23. New York, NY, USA. DOI: https://doi.org/10.1145/2885497

• Joel Scheuner, Jürgen Cito, Philipp Leitner, and Harald Gall (2015), Cloud WorkBench: Benchmarking IaaS Providers based on Infrastructure-as-Code, in Proceedings of the 24th International World Wide Web Conference (WWW’15) – Demo Track, 2015. DOI: https://doi.org/10.1145/2740908.2742833

• Philipp Leitner, Joel Scheuner (2015). Bursting With Possibilities – an Empirical Study of Credit-Based Bursting Cloud Instance Types. In Proceedings of the 8th IEEE/ACM International Conference on Utility and Cloud Computing (UCC). DOI: https://doi.org/10.1109/UCC.2015.39

• Joel Scheuner, Philipp Leitner, Jürgen Cito, and Harald Gall (2014), Cloud WorkBench – Infrastructure-as-Code Based Cloud Benchmarking, in Proceedings of the 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’14), 2014. DOI: https://doi.org/10.1109/CloudCom.2014.98

Screenshots

Installation

Interested in your own Cloud WorkBench installation?
Feel free to contact us: philipp.leitner[AT]chalmers.se or scheuner[AT]chalmers.se

Most parts are automated and configurable via Chef, some manual steps are required to setup credentials and Chef server configuration.

Step-by-step guidance is given here: https://github.com/sealuzh/cwb-chef-repo

Deployment

Automated as part of the installation or manually triggerable.