Sketch of detached mode for K8s

V0.4.4 (#52)

* Prepare next release

* Masterscript: K8s allow overwriting dialect

* Masterscript: K8s change setting outside of constructor

* Masterscript: get_connection_config()

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch - replace jar folder statically

* Masterscript: K8s Driver in K8s cluster first sketch - delete job and pod after success

* Masterscript: K8s Driver in K8s cluster first sketch - fixed code

* Masterscript: K8s Driver in K8s cluster first sketch - dynamic code and connection

* Masterscript: K8s Driver in K8s cluster first sketch - remove fixed code

* Masterscript: K8s Driver in K8s cluster first sketch - wait for client pod to run

* Masterscript: K8s Driver in K8s cluster first sketch - print status of client pod

* Masterscript: K8s Driver in K8s cluster first sketch - dbmsbenchmarker pod shall wait 60s (str)

* Masterscript: K8s Driver in K8s cluster first sketch - wait 60s for client pod to close

* Docs: Typo

* Docs: Reference to DBMSBenchmarker and Monitoring

* Masterscript: K8s wait without tqdm

* Masterscript: K8s copy Prometheus API URL

* Masterscript: K8s port forward to service name again

* Masterscript: K8s stop port forward in detached

* Masterscript: Add more labels to K8s objects

* Masterscript: Add more labels to K8s objects - benchmarker job

* Masterscript: Add more labels to K8s objects - sut deployment

* Masterscript: Add more labels to K8s objects - sut deployment configuration

* Masterscript: Add more labels to K8s objects - service name

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - delete by labels

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Start code

* Masterscript: Start code

* Masterscript: Add more labels to K8s objects - experiment

* Masterscript: Add more labels to K8s objects - experiment

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: SUT deployment generated in result folder

* Masterscript: Set SUT deployment and service name

* Masterscript: Set SUT deployment and service name - lower and no _

* Masterscript: Set benchmarker job name

* Masterscript: Set SUT service name for benchmarker

* Masterscript: Delete all pods of a job

* Masterscript: K8s connection and configuration different

* Masterscript: K8s client for benchmarker jobs

* Masterscript: K8s client for benchmarker jobs

* Masterscript: K8s client for benchmarker jobs - connect to sut

* Masterscript: K8s connection and configuration different

* Masterscript: Message for no matching job

* Masterscript: K8s client for monitoring deployment - connect to sut

* Masterscript: K8s node selector should not be None

* Masterscript: K8s node selector should not be None

* Masterscript: K8s monitoring customized url

* Masterscript: K8s write pod logs

* Masterscript: K8s copy job yaml to result folder

* Masterscript: K8s sketch of configuration class

* Masterscript: K8s make result folder if not exists

* Masterscript: K8s sketch of merging results in dashboard pod

* Masterscript: K8s sketch of merging results in dashboard pod

* Masterscript: K8s sketch of merging results in dashboard pod

Improve inspection, TPC-H example and K8s management

V0.4.3 (#40)

* Prepare next release

* Docs: Monitoring

* K8s: v1apps.list_namespaced_deployment (new K8s version in cluster)

* K8s: Resultfolder as attribute of cluster object

* Masterscript: K8s store number of requested gpus

* Masterscript: K8s run shell scripts for loading data

* Masterscript: Allow list of jars per dbms

* Requirements: Allow current versions

* TPC-H: New specifics

* Masterscript: K8s monitoring as option

* Masterscript: K8s optional UPPER parameter of db and schema

* Masterscript: K8s DEPRECATED: we must know all jars upfront

* TPC-H: DDL for MariaDB Columnstore

* TPC-H: Bigint at MonetDB

* TPC-H: SQL Server precision and DB

* TPC-H: OmniSci sharding

* TPC-H: OmniSci template

Improve Documentation

V0.4.2 (#36)

* Prepare next release

* K8s: Parametrize DDL scripts

* K8s: No pickled reports

* Demo: Typo

* Docs: API of set_ methods

* Docs: Deployments

* Docs: DBMS

* Docs: References

Improve Documentation and TPC-H Example

V0.4.1 (#35)

* Prepare next release

* Docs: Improve

* self.connectionmanagement['singleConnection'] optional

* Docs: Improve API

* K8s: Stop experiment does not delete pod

* Docs: Improve API

* Docs: Improve API

* K8s: Script as metadata

* K8s: Escape DBMS password

* TPC-H: Dialect TSQL and Oracle

* TPC-H: Demo config

* TPC-H: Demo Exasol, OracleDB, SQLServer

TPC-H like examples

V0.3.11 (#34)

* Prepare next release

* K8s: Some demo yml files for deployments and services

* TPC-H: Some demo queries and init scripts

* TPC-H: Some demo configs and scripts

* Docs: TPC-H example

* Prepare next release 0.4.0

Improved API and workflow

v0.3.10

Legal notice in source code

Improved workflow

• Masterscript: AWS - store log of last stop and clean
• Masterscript: AWS - log volume key
• Masterscript: Querymanagement
• Masterscript: Read experiments log
• Masterscript: Test if experiments path exists
• Masterscript: setCode for continuing experiments
• Masterscript: K8s more infos about host - monitoring metrics of multiple gpus
• Masterscript: K8s - getTimediff
• Masterscript: K8s more infos about host - debugging
• Masterscript: K8s more infos about host - monitoring metrics
• Masterscript: K8s more infos about host - gpu ids and node
• Masterscript: K8s catch missing portforwarding in stop
• Masterscript: K8s escape $ in some kubectl commands
• Masterscript: K8s getMemory() for python 03. Jul
• Masterscript: K8s kubectl as list, Popen, Shell
• Masterscript: AWS - set alias
• Masterscript: AWS - add / to config path
• Masterscript: K8s - delay in runExperiment()
• Docs: Alternative workflows, (un)park, experiments.config
• Masterscript: K8s - add / to config path
• Masterscript: Load experiment workflow
• Masterscript: K8s - remove C: from download
• Masterscript: AWS - log workflow
• Masterscript: Load experiment workflow
• Masterscript: K8s - log workflow
• Masterscript: K8s - delay in prepare and start, log experimental steps
• Docs: Monitoring, reporting, experiments.config
• Masterscript: AWS - monitoring exporters in config
• Masterscript: K8s - allow different query files for same workload
• Masterscript: runReporting() for AWS
• Masterscript: More details for k8s
• Masterscript: Prevent crash at missing data
• Masterscript: Init paths for K8s corrected
• Docs: Minor extensions
• Masterscript: SSH bug in k8s init
• Masterscript: Wait 30s after unpark
• Masterscript: Wait after unpark
• Masterscript: UnparkExperiment removes old docker
• Masterscript: ParkExperiment removes old parked
• Masterscript: Default connectionname for unpark
• Masterscript: Write connection prettily
• Masterscript: Sketch park/unpark experiment
• Hardware: RAM in bytes from /proc/meminfo
• Prepare new version
• Hardware: RAM in bytes, disk space in Kb

Public

V0.3.8 (#2)

* Initial state

* Create LICENSE