CloudSuite 4.0 Workload Status Matrix

✔️: Done ✖️:Failed 🚧: Not Supported 🏃:Being Tested

Benchmark	Build on x86	Run on x86	Build on ARM	Run on ARM	Build on RISC-V	Run on RISC-V	Load generator	Tuned?	Automated	Measurement	QFlex
data-analytics	✔️	✔️	✔️	✔️	✔️	❌(#330)	-	No	✔️	✖️
data-caching*	✔️	✔️	✔️	✔️	✔️	✔️	open	Link	✔️	✖️
data-serving*	✔️	✔️	✔️	✔️	✔️	✖️[1]	YCSB (Close++)	Link	✔️	✖️
django-workload*	✔️	✔️	✔️	✔️	graphite-webtier: 🚧	🚧	Siege (Close)	No	✔️	✖️
in-memory-analytics	✔️	✔️	✔️	✔️	✔️	❌(#323)	-	No	✔️	✖️
fb-oss-performance*	✔️	✔️	🚧	🚧	🚧	🚧	Siege (close)	Mediawiki, Wordpress, Drupal8	✔️	✖️
graph-analytics	✔️	✔️	✔️	✔️	✔️	✔️	-	No	✔️	✖️
media-streaming*	✔️	✔️	✔️	✔️	✔️	✔️	httperf	✔️	✔️	✖️
web-search*	✔️	✔️	✔️	✔️	🚧	🚧	Faban (close)	✔️	✔️	✖️
web-serving*	✔️	✔️	✔️	🏃	🚧	🚧	Faban	🏃	✖️	✖️

[*] are online services workloads.

Software Package	Build on x86	Build on ARM	Build on RISC-V	Required by
twitter-dataset-graph	✔️	✔️	✔️	graph-analytics
movielens-dataset	✔️	✔️	✔️	-
java:openjdk11	✔️	✔️	✔️	hadoop:2.10.1 cassandra:3.11.6 django:graphite-statsd memcached:1.6.6 siege:4.0.3rc3 spark:2.4.5 faban:1.4 web-serving web-search
hadoop:2.10.1	✔️	✔️	✔️	data-analytics
cassandra:3.11.6	✔️	✔️	✔️	data-caching data-serving django-workload:cassandra
django:graphite-statsd	✔️	✔️	🚧	django-workload:graphite
memcached:1.6.6	✔️	✔️	✔️	django-workload:memcached web-serving
siege:4.0.3rc3	✔️	✔️	✔️	django-workload:siege fb-oss-performance
spark:2.4.5	✔️	✔️	✔️	in-memory-analytics graph-analytics
mysql:mariadb-10.3	✔️	✔️	✔️	web-serving fb-oss-performance
hhvm:3.30	✔️	🚧	🚧	fb-oss-performance
java:adoptopenjdk8	✔️	✔️	🚧	web-search
faban:1.4	✔️	✔️	✔️	web-search web-serving

[1]: Cannot parse address inside docker:

Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: Unknown listen_address 'fec0::5054:ff:fe12:3456 10.0.2.15 172.17.0.1 fe80::5054:ff:fe12:3456 fe80::42:d8ff:feaf:1710'
ERROR [main] 2021-07-19 18:18:01,079 CassandraDaemon.java:774 - Exception encountered during startup: Unknown listen_address 'fec0::5054:ff:fe12:3456 10.0.2.15 172.17.0.1 fe80::5054:ff:fe12:3456 fe80::42:d8ff:feaf:1710'
Unknown listen_address 'fec0::5054:ff:fe12:3456 10.0.2.15 172.17.0.1 fe80::5054:ff:fe12:3456 fe80::42:d8ff:feaf:1710'

Comparison Between CS3 and CS4

Software	CS3	CS4
OS	Ubuntu 16.04	Debian Buster
data-analytics	Hadoop 2.7.4 (2017) Mahoot 0.12.2 (2016) dataset: enwiki-latest-pages-articles1.xml-p10p30302.bz2	Hadoop 2.10.1 (2020) Mahoot 0.13.0 (2017) dataset: enwiki-latest-pages-articles1.xml-p1p41242.bz2
data-caching	Memcached 1.4.24 (2015)	Memcached 1.6.10 (2021)
data-serving	Cassandra 2.1.12 (2015) YCSB 0.3.0 (2015)	Cassandra 3.11.6 (2020) YCSB 0.14.0 (2018)
django-workload	-	Added in CS4
fb-oss-performance	-	Added in CS4
graph-analytics	Spark 2.1.0 (2016) Scala 2.10.4 (2017)	Spark 2.4.5 (2020) Scala 2.11.12 (2017)
in-memory-analytics	Spark 2.1.0 (2016) Scala 2.10.4 (2017)	Spark 2.4.5 (2020) Scala 2.11.12 (2017)
media-streaming	datasets: raw plain text files no encryption	dataset: real videos TLSv3 encryption bug fixes
web-search	client: openjdk7 server: Solr 5.2.1 (2015)	client: openjdk11 Solr 6.6.6 (2019)
web-serving	Ubuntu 14.04 Elgg 1.9.3 (2014) Php 5 (2016) MySQL 5.5.62 (2018)	Ubuntu 20.04 Elgg 3.3.20 (2021) Php 7.4 (2019) MariaDB 10.3.29 (2021)