Adding Renaissance Benchmark

.gitignore

@@ -5,4 +5,5 @@ acmeair/acmeair/.metadata
 acmeair/acmeair/.classpath
 acmeair/acmeair/.project
 acmeair/acmeair/.gradle
+.idea/
 acmeair/jmeter-driver/acmeair-jmeter/build

renaissance/README.md

@@ -0,0 +1,58 @@
+
+# About The Benchmark
+The Renaissance Benchmark Suite aggregates common modern JVM workloads, including, but not limited to, Big Data, machine-learning, and functional programming. The suite is intended to be used to optimize just-in-time compilers, interpreters, GCs, and for tools such as profilers, debuggers, or static analyzers, and even different hardware. It is intended to be an open-source, collaborative project, in which the community can propose and improve benchmark workloads.
+
+More information about this benchmark can be found on [Renaissance](https://github.com/renaissance-benchmarks/renaissance)
+# Prerequisites
+To generate the results from the Renaissance Benchmark,we need to:  
+
+ - Install minikube(kubernetes cluster),which can be done from [Minikube](https://minikube.sigs.k8s.io/docs/start/) and then install prometheus on the minikube cluster. This can be done by following the steps in the [Autotune Installation](https://github.com/kruize/autotune/blob/master/docs/autotune_install.md). 
+
+ You,also need to install a driver of your choice for running  renaissance onto your local system
+
+ Download a driver (docker or podman)
+
+ [Docker](https://docs.docker.com/engine/install/)
+
+ [Podman](https://podman.io/getting-started/installation)
+
+ # How To Run This Benchmark
+
+ To run the benchmark on kubernetes cluster to collect performance metrics
+
+ ./scripts/perf/renaissance-run.sh --clustertype=CLUSTER_TYPE -s BENCHMARK_SERVER -e RESULTS_DIR_PATH [-w WARMUPS] [-m MEASURES] [-i TOTAL_INST] [--iter=TOTAL_ITR] [-r= set redeploy to true] [-n NAMESPACE] [-g RENAISSANCE_IMAGE] [--cpureq=CPU_REQ] [--memreq=MEM_REQ] [--cpulim=CPU_LIM] [--memlim=MEM_LIM] [-b BENCHMARKS] [-R REPETITIONS] [-d DURATION] "
+
+ - **CLUSTER_TYPE**: Type of cluster. Supports openshift , minikube.
+- **BENCHMARK_SERVER**: Name of the cluster you are using
+- **RESULTS_DIR_PATH**: Directory to store results
+- **DURATION**: Duration of each warmup and measurement run.
+- **WARMUPS**: No.of warmup runs.
+- **MEASURES**: No.of measurement runs.
+- **ITERATIONS**: No.of iterations.
+- **CPU_REQ**: CPU request
+- **MEM_REQ**: Memory request
+- **CPU_LIM**: CPU limit
+- **MEM_LIM**: Memory limit
+- **RENAISSANCE_IMAGE**:prakalp23/renaissance1041:latest 
+- **BENCHMARKS**:Choice of a microbenchmark from Renaissance [Microbenchmarks](https://github.com/renaissance-benchmarks/renaissance)
+
+Example:./renaissance-run.sh --clustertype=minikube -s localhost -e ./results -w 1 -m 1 -i 1 --iter=1 -r -n default  --cpureq=1.5 --memreq=3152M --cpulim=1.5 --memlim=3152M -b "page-rank" -g prakalp23/renaissance1041:latest -d 60
+
+ # The Experiment Results
+
+ The experiment results using the above scripts generates a csv file which contains the resource usage information for the Renaissance Benchmark can be found here
+
+ [Renaissance Results](https://github.com/Prakalp23/autotune-results/tree/renaissance/Renaissance)
+
+
+## Scripts Details
+
+| Script Name                   |       What it does?																			|
+|-------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| perf/getmetrics-promql.sh     |       Has prometheus queries that are required calculate the metrics required for objective function and the benchmark.                                       	|
+| perf/parsemetrics-promql.sh   |       Parse the prometheus metrics data to calculate the average , max and min values as per the requirement of the benchmark.                                	|
+| perf/ci.php			|	Use to measure confidence interval of data.															|
+| perf/parsemetrics-wrk.sh      |       Parse the metrics data from hyperfoil/wrk load simulator.                                                                                               	|
+
+
+

renaissance/docker/Dockerfile

@@ -0,0 +1,10 @@
+FROM eclipse-temurin:17.0.3_7-jre
+WORKDIR /target
+RUN wget https://github.com/renaissance-benchmarks/renaissance/releases/download/v0.14.1/renaissance-gpl-0.14.1.jar
+COPY renaissance-gpl-0.14.1.jar /target/renaissance-gpl-0.14.1.jar
+ADD https://repo1.maven.org/maven2/io/prometheus/jmx/jmx_prometheus_javaagent/0.17.0/jmx_prometheus_javaagent-0.17.0.jar
+COPY config.yaml config.yaml
+ENV JDK_JAVA_OPTIONS=
+ENV BENCHMARK=all
+ENV TIME_LIMIT=5
+ENTRYPOINT java -javaagent:./jmx_prometheus_javaagent-0.17.0.jar=8080:config.yaml ${JDK_JAVA_OPTIONS} -jar /target/renaissance-gpl-0.14.1.jar -t ${TIME_LIMIT} --csv /output/renaissance-output.csv ${BENCHMARK}

renaissance/docker/config.yaml

@@ -0,0 +1,2 @@
+rules:
+- pattern: ".*"

renaissance/manifests/renaissance.yaml

@@ -0,0 +1,54 @@
+apiVersion: apps/v1
+kind: Deployment
+metadata:
+  name: renaissance-sample
+  labels:
+    app: renaissance-app
+spec:
+  replicas: 1
+  selector:
+   matchLabels:
+     app: renaissance-deployment
+  template:
+    metadata:
+      labels:
+        name: renaissance-deployment
+        app: renaissance-deployment
+        # Add label to the application which is used by kruize/autotune to monitor it
+        app.kubernetes.io/name: "renaissance-deployment"
+        app.kubernetes.io/layer: "hotspot"
+        version: v1
+    spec:
+      volumes:
+      - name: test-volume
+      containers:
+      - name: renaissance-server
+        image: prakalp23/renaissance1041:latest
+        imagePullPolicy: IfNotPresent
+        env:
+        ports:
+          - containerPort: 8080
+        resources:
+         requests:
+         limits:
+        volumeMounts:
+          - name: "test-volume"
+            mountPath: "/opt/jLogs"
+---
+apiVersion: v1
+kind: Service
+metadata:
+  name: renaissance-service
+  annotations:
+    prometheus.io/scrape: 'true'
+    prometheus.io/path: '/metrics'
+  labels:
+    app: renaissance-app
+spec:
+  type: NodePort
+  ports:
+    - port: 8080
+      targetPort: 8080
+      name: renaissance-port
+  selector:
+    name: renaissance-deployment

renaissance/manifests/service-monitor.yaml

@@ -0,0 +1,13 @@
+apiVersion: monitoring.coreos.com/v1
+kind: ServiceMonitor
+metadata:
+  name: renaissance
+  labels:
+    team: renaissance-frontend
+spec:
+  selector:
+    matchLabels:
+        app: renaissance-app
+  endpoints:
+    - port: renaissance-port
+      path: '/metrics'

renaissance/readme

@@ -0,0 +1,2 @@
+# to run the benchmark
+./renaissance-run.sh --clustertype=minikube -s localhost -e ./results -w 1 -m 1 -i 1 --iter=1 -r -n default  --cpureq=1.5 --memreq=3152M --cpulim=1.5 --memlim=3152M -b "page-rank" -d 60