Part of my code for the Datalab project developed for the European Southern Observatory (ESO).
It contains among other things many Dockers with images of the installed databases (Elasticsearch, Cassandra, Elasandra, etc). Puppet files to automatically install docker compose. Python scripts, c++ to parse, inject the data into the databases. Installation also of Kibana, Grafana, etc. and
Dockers with own miscellaneous applications.
Everything is a little messy.
Big Data Analysis:
- Installation Datalab for Observatory Logs:
Elasticsearch,Cassandra,Elassandra,Kairosdb. - Servers orchestration:
Puppet. - Installation and work with Data Analytic tools, ELK:
Jupyter,Grafana,Kibana. - Security:
Reverse proxy,openScap,openVAS,Seccubus,Dagda. - Anomaly detection:
Python(Pandas,TensorFlow). - Script:
Python,Bash. - Data Visualization:
Python(Matplotlib,Bokeh,Plotly).