-
Notifications
You must be signed in to change notification settings - Fork 121
CloudSuite 4.0 Workload Status Matrix
Cyan Lin edited this page Feb 11, 2023
·
60 revisions
✔️: Done ✖️:Failed 🚧: Not Supported 🏃:Being Tested
| Benchmark | Build on x86 | Run on x86 | Build on ARM | Run on ARM | Build on RISC-V | Run on RISC-V | Load generator | Tuned? | Automated | Measurement | QFlex |
|---|---|---|---|---|---|---|---|---|---|---|---|
| data-analytics | ✔️ | ✔️ | ✔️ | ❌(#330) | - | No | ✔️ | ✖️ | |||
| data-caching* | ✔️ | ✔️ | ✔️ | open | Link | ✔️ | ✖️ | ||||
| data-serving* | ✔️ | ✔️ | ✔️ | ✖️[1] | YCSB (Close++) | Link | ✔️ | ✖️ | |||
| in-memory-analytics | ✔️ | ✔️ | ✔️ | ❌(#323) | - | No | ✔️ | ✖️ | |||
| graph-analytics | ✔️ | ✔️ | ✔️ | - | No | ✔️ | ✖️ | ||||
| media-streaming* | ✔️ | ✔️ | ✔️ | httperf | ✔️ | ✔️ | ✖️ | ||||
| web-search* | ✔️ | ✔️ | ✔️ | ✖️ | Faban (close) | ✔️ | ✔️ | ✖️ | |||
| web-serving* | ✔️ | ✔️ | ✔️ | Faban | 🏃 | ✖️ | ✖️ |
[*] are online services workloads.
| Software Package | Build on x86 | Build on ARM | Build on RISC-V | Required by |
|---|---|---|---|---|
| twitter-dataset-graph | ✔️ | ✔️ | ✔️ | graph-analytics |
| movielens-dataset | ✔️ | ✔️ | ✔️ | - |
| java:openjdk11 | ✔️ | ✔️ | ✔️ | hadoop:2.10.1 cassandra:3.11.6 django:graphite-statsd siege:4.0.3rc3 spark:2.4.5 faban:1.4 web-serving web-search |
| hadoop:2.10.1 | ✔️ | ✔️ | ✔️ | data-analytics |
| cassandra:3.11.6 | ✔️ | ✔️ | ✔️ | data-caching data-serving django-workload:cassandra |
| memcached:1.6.15 | ✔️ | ✔️ | ✔️ | django-workload:memcached web-serving data-caching |
| siege:4.0.3rc3 | ✔️ | ✔️ | ✔️ | django-workload:siege fb-oss-performance |
| spark:2.4.5 | ✔️ | ✔️ | ✔️ | in-memory-analytics graph-analytics |
| mysql:mariadb-10.3 | ✔️ | ✔️ | ✔️ | web-serving fb-oss-performance |
| faban:1.4 | ✔️ | ✔️ | ✔️ | web-search web-serving |
[1]: Cannot parse address inside docker:
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: Unknown listen_address 'fec0::5054:ff:fe12:3456 10.0.2.15 172.17.0.1 fe80::5054:ff:fe12:3456 fe80::42:d8ff:feaf:1710'
ERROR [main] 2021-07-19 18:18:01,079 CassandraDaemon.java:774 - Exception encountered during startup: Unknown listen_address 'fec0::5054:ff:fe12:3456 10.0.2.15 172.17.0.1 fe80::5054:ff:fe12:3456 fe80::42:d8ff:feaf:1710'
Unknown listen_address 'fec0::5054:ff:fe12:3456 10.0.2.15 172.17.0.1 fe80::5054:ff:fe12:3456 fe80::42:d8ff:feaf:1710'
Comparison Between CS3 and CS4
| Software | CS3 | CS4 |
|---|---|---|
| OS | Ubuntu 16.04 | Debian Buster |
| data-analytics | Hadoop 2.7.4 (2017) Mahout 0.12.2 (2016) dataset: enwiki-latest-pages-articles1.xml-p10p30302.bz2 |
Hadoop 2.10.1 (2020) Mahout 0.13.0 (2017) dataset: enwiki-latest-pages-articles1.xml-p1p41242.bz2 |
| data-caching | Memcached 1.4.24 (2015) | Memcached 1.6.15 (2022) |
| data-serving | Cassandra 2.1.12 (2015) YCSB 0.3.0 (2015) |
Cassandra 3.11.6 (2020) YCSB 0.14.0 (2018) |
| graph-analytics | Spark 2.1.0 (2016) Scala 2.10.4 (2017) |
Spark 2.4.5 (2020) Scala 2.11.12 (2017) |
| in-memory-analytics | Spark 2.1.0 (2016) Scala 2.10.4 (2017) |
Spark 2.4.5 (2020) Scala 2.11.12 (2017) |
| media-streaming | datasets: raw plain text files no encryption |
dataset: real videos TLSv3 encryption bug fixes |
| web-search | client: openjdk7 server: Solr 5.2.1 (2015), java: openjdk7 |
client: openjdk11 server: Solr 6.6.6 (2019), java: adoptopenjdk8 |
| web-serving | Ubuntu 14.04 Elgg 1.9.3 (2014) Php 5 (2016) MySQL 5.5.62 (2018) Memcached 1.4.14 (2012) |
Ubuntu 20.04 Elgg 4.3 (2022) Php 8.1 (2022) MariaDB 10.3.29 (2021) Memcached 1.6.15 (2022) |