Skip to content
This repository has been archived by the owner on Nov 1, 2024. It is now read-only.

Fix cadvisor and node exporter configs #7

Merged
merged 1 commit into from
Jan 22, 2024

Conversation

matofeder
Copy link
Member

The 'docker_only' scope in cAdvisor is well-suited, ensuring a reduced footprint for the cAdvisor service.

The node_exporter exludes various mount points and file system types by default. You can review the exclusions at https://github.com/prometheus/node_exporter/blob/v1.7.0/collector/filesystem_linux.go#L38

Related issue: SovereignCloudStack/issues#398

The 'docker_only' scope in cAdvisor is well-suited, ensuring a reduced
footprint for the cAdvisor service.

The node_exporter exludes various mount points and file system types by default.
You can review the exclusions at https://github.com/prometheus/node_exporter/blob/v1.7.0/collector/filesystem_linux.go#L38

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
@matofeder matofeder requested a review from o-otte January 22, 2024 14:53
Copy link
Member

@o-otte o-otte left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, thank you!

@o-otte o-otte merged commit 79f0a34 into prepare_gx-scs_deployment Jan 22, 2024
1 check passed
@o-otte o-otte deleted the fix_prepare_gx-scs_deployment branch January 22, 2024 14:59
PixelPhantomX pushed a commit that referenced this pull request Feb 23, 2024
The 'docker_only' scope in cAdvisor is well-suited, ensuring a reduced
footprint for the cAdvisor service.

The node_exporter exludes various mount points and file system types by default.
You can review the exclusions at https://github.com/prometheus/node_exporter/blob/v1.7.0/collector/filesystem_linux.go#L38

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
o-otte pushed a commit that referenced this pull request Feb 23, 2024
The 'docker_only' scope in cAdvisor is well-suited, ensuring a reduced
footprint for the cAdvisor service.

The node_exporter exludes various mount points and file system types by default.
You can review the exclusions at https://github.com/prometheus/node_exporter/blob/v1.7.0/collector/filesystem_linux.go#L38

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
o-otte added a commit that referenced this pull request Feb 26, 2024
* Prepare Zuul Deployment on GX-SCS

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* Fix Terraform, set Variables for gx-scs

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* COnfig Changes for gx-scs deployment

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* change gitignore settings

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* add additional python libraries

Signed-off-by: Benjamin Zapiec <zapiec@gonicus.de>

* remove additional modules

Signed-off-by: Benjamin Zapiec <zapiec@gonicus.de>

* remove duplicate module definition

Signed-off-by: Benjamin Zapiec <zapiec@gonicus.de>

* update playbook to fullfill new variable name

Signed-off-by: Benjamin Zapiec <2255421+master-caster@users.noreply.github.com>
Signed-off-by: Benjamin Zapiec <zapiec@gonicus.de>

* add initial certifcate creation

Signed-off-by: Benjamin Zapiec <zapiec@gonicus.de>

* - update flavor naming
- add standards repo

Signed-off-by: Benjamin Zapiec <zapiec@gonicus.de>

* Amendments to deployment manifests

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* Removed hashtags

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changed pool max-servers from 10 to 4

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added a virtualHost to httpd.conf for letsencrypt use

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Minor name amendment

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changed layout and indentations

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Made changes to the way the letsencrypt virtualhost is inserted into the config

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Minor corrections

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Add Terraform Config to deploy dev resources

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* Add Ansible Roles and Playbook for Exporters

- Node Exporter
- Statsd Exporter
- cAvisor

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* Updates on Ansible Roles

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>
Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added a host condition to untrusted projects

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added a pip installer

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changed pip installer exist checking before install

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changed hosts for pip installer

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added checks for pip installation

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Removed pip.yaml

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changed clouds file handling for dev

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Cleaned up the pip installation

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Updated vars and playbook to allow for dev domain names

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Fix cadvisor and node exporter configs (#7)

The 'docker_only' scope in cAdvisor is well-suited, ensuring a reduced
footprint for the cAdvisor service.

The node_exporter exludes various mount points and file system types by default.
You can review the exclusions at https://github.com/prometheus/node_exporter/blob/v1.7.0/collector/filesystem_linux.go#L38

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>

* Corrected FQDN for dev

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Corrected quotes in fqdn vars

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Corrected condition of untrusted list and also for fqdn

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changed httpd.conf post changes

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changed container restart to remove link

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Changes to restart method and certbot domain vars

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added uniques httpd.conf ansible marker block names

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added changes to docker-compose file and changed restart method

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added MQTT details to the vault

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Removed MQTT details from the vault

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Add MQTT connection to the Zuul configuration (#8)

To view Zuul reports in the Matrix chat, we must use Zuul MQTT reports.
Since the direct path from MQTT to Matrix is unsupported,
we send MQTT reports through the zuul-mqtt-matrix-bridge,
which acts as a relay, transferring MQTT reports from Zuul to the Matrix chat.

This commit adds the MQTT connection to the Zuul configuration file.

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Various changes to create required resources for letsencrypt

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Small change to the ssl file copy method

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Add http and https ports to Zuul Security Group

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* Enable Zuul Scheduler and Zookeeper metrics (#9)

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
Signed-off-by: Roy Farrell <farrell@gonicus.de>

* change Ansible Version to 2.10.0 (#327)

Signed-off-by: Ramona Rautenberg <rautenberg@osism.tech>

* zuul: use ansible builtin tasks (#469)

- Use the ansible.builtin.tasks in the ansible-collection-services/roles/zuul Repo
- This is partly from the github issue: osism/issues#63

Signed-off-by: Ramona Rautenberg <rautenberg@osism.tech>

* ansible: add osism tag (#526)

partly: osism/issues#81

Signed-off-by: Ramona Rautenberg <rautenberg@osism.tech>

* Update zuul role (#634)

- Add nodepool-builder container
- Use tags for container versions
- Deploy logging config for all services
- Use pre-configured SSH key for nodepool/zuul

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Update zuul to 5.2.2 (#658)

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Update webserver to use SSL (#649)

- Use unmodified httpd container and bindmount the configuration
- Serve content via https, redirect http to https
- Make directory indexing for logs a bit nicer
- Use httpd as reverse proxy for zuul-web

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Fix logging path in zuul role (#665)

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Add zuul job to create role documentation (#685)

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Update zuul and nodepool to 6.0.0 (#705)

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Change the place of the become condition (#767)

Partly osism/issues#232

Signed-off-by: Ramona Rautenberg <rautenberg@osism.tech>

* Add README.md to make ansible-galaxy happy (#789)

Related to osism/issues#252

Signed-off-by: Ramona Rautenberg <rautenberg@osism.tech>

* Make container image names identical to other repositories (#786)

Signed-off-by: Tim Beermann <beermann@osism.tech>

* Fix Ansible-Lint-Errors upcoming after the last Version update (#846)

Partly osism/issues#326

Signed-off-by: Ramona Beermann <rautenberg@osism.tech>

* Remove docker compose version (pt. 2) (#885)

Signed-off-by: Christian Berendt <berendt@osism.tech>

* Change copyright date (#910)

Partly osism/issues#394

Signed-off-by: Ramona Beermann <ramona.beermann@osism.tech>

* Update zuul role (#953)

* zuul: Fix variable names for nodepool images

These were mismatched in #786

* zuul: Update docker images to latest tags

New images released for zuul, nodepool and zookeeper.

* zuul: Add auth config for zuul_operator

This allows tokens to be generated and used in zuul-client, e.g. for
managing autoholds.

* Add zuul_user definition to zuul role defaults


Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Update container versions in zuul role (#955)

Rename zuul_tag variable to zuul_zuul_tag for consistency. Keep
definition blocks in alphabetic ordering.

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Update zuul and nodepool versions

Both have had a new release with version 8.2.0.

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* Meta: Add jammy to supported plattforms (#965)

- Partly osism/issues#373
- Updrate Ansible-version in meta runtime: partly osism/issues#450

Signed-off-by: Ramona Beermann <ramona.beermann@osism.tech>

* Add Zuul installation guide (#959)

Since the successful installation of a Zuul deployment is a bit more
complicated than simply applying the service role, we document it in a
dedicated chapter of the documentation.

Make zuul variables role specific:

Role variable names should have the role name as prefix in order to
avoid conflicts with other roles, amend the zuul role accordingly.

* zuul: Update image references (#1147)

The Zuul project has moved publishing their container images to
quay.io, update the image references accordingly.

Also update to use the current latest tagged versions for both Zuul and
Nodepool.

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* zuul: Make volume settings configurable

- Allow to add mariadb data volume
- Add variable for log_server volume name/path

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>

* zuul: add restart policy unless-stopped

Signed-off-by: Christian Berendt <berendt@osism.tech>

* Add Statsd configuration options for Zuul

This commit enables the configuration of Zuul Scheduler and
Zuul Nodepool builder and launcher to emit metrics to the statsd receiver.

For configuring the Zuul Scheduler, the zuul.conf file should be
adjusted, see https://zuul-ci.org/docs/zuul/latest/configuration.html#attr-statsd.

For the configuration of the Zuul Nodepool launcher and builder,
the environment variables should be set, see https://zuul-ci.org/docs/nodepool/latest/installation.html#statsd-configuration.

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>

* Add metrics configuration option for Zookeeper

This commit enables the configuration of Zuul's Zookeeper component
to expose metrics on the specified port.

Signed-off-by: Matej Feder <matej.feder@dnation.cloud>

* Created branch with only zuul role contents

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Removed readme files

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Added a zuul role

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Removed excess zuul directory

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* added pre-commit for gitleaks

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Removed clouds-dev.yaml and changed host names in config file

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Updated hostname in inventory

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Removed test file creation

Signed-off-by: Roy Farrell <farrell@gonicus.de>

* Update .gitignore

Signed-off-by: Roy Farrell <152626360+PixelPhantomX@users.noreply.github.com>

* Add terraform related gitignore settings

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* Remove Statefiles from git

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>

* Local zuul (#12)

* Creating branch for moving zuul role from OSISM to local

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* added pre-commit for gitleaks

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Creating new branch for local zuul role to replace the OSISM implementation

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Removed the zuul role from .gitignore

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Removing clouds-dev.yaml

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Removing clouds-dev.yaml

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Testing .gitignore change

Signed-off-by: Roy Farrell <farrell@gonicus.de>
Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Added files directory

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Added files directory creation to playbook

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

---------

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>
Signed-off-by: Roy Farrell <farrell@gonicus.de>
Signed-off-by: Roy Farrell <152626360+PixelPhantomX@users.noreply.github.com>

* Local zuul (#13)

* Creating branch for moving zuul role from OSISM to local

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* added pre-commit for gitleaks

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Creating new branch for local zuul role to replace the OSISM implementation

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Removed the zuul role from .gitignore

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Removing clouds-dev.yaml

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Removing clouds-dev.yaml

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Testing .gitignore change

Signed-off-by: Roy Farrell <farrell@gonicus.de>
Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Added files directory

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

* Added files directory creation to playbook

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>

---------

Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>
Signed-off-by: Roy Farrell <farrell@gonicus.de>
Signed-off-by: Roy Farrell <152626360+PixelPhantomX@users.noreply.github.com>

---------

Signed-off-by: Oliver Kautz <oliver.kautz@gonicus.de>
Signed-off-by: Benjamin Zapiec <zapiec@gonicus.de>
Signed-off-by: Benjamin Zapiec <2255421+master-caster@users.noreply.github.com>
Signed-off-by: Roy Farrell <farrell@gonicus.de>
Signed-off-by: Matej Feder <matej.feder@dnation.cloud>
Signed-off-by: Ramona Rautenberg <rautenberg@osism.tech>
Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>
Signed-off-by: Tim Beermann <beermann@osism.tech>
Signed-off-by: Ramona Beermann <rautenberg@osism.tech>
Signed-off-by: Christian Berendt <berendt@osism.tech>
Signed-off-by: Ramona Beermann <ramona.beermann@osism.tech>
Signed-off-by: Roy Farrell <152626360+PixelPhantomX@users.noreply.github.com>
Signed-off-by: farrell@gonicus.de <farrell@gonicus.de>
Co-authored-by: Benjamin Zapiec <zcbn9343@largo.intranet.gonicus.de>
Co-authored-by: Benjamin Zapiec <2255421+master-caster@users.noreply.github.com>
Co-authored-by: Benjamin Zapiec <zapiec@gonicus.de>
Co-authored-by: farrell@gonicus.de <farrell@gonicus.de>
Co-authored-by: Matej Feder <feder.mato@gmail.com>
Co-authored-by: ra-rau <80961037+ra-rau@users.noreply.github.com>
Co-authored-by: Dr. Jens Harbott <86402919+osfrickler@users.noreply.github.com>
Co-authored-by: Tim Beermann <beermann@osism.tech>
Co-authored-by: Ramona Beermann <80961037+ra-beer@users.noreply.github.com>
Co-authored-by: Christian Berendt <berendt@osism.tech>
Co-authored-by: Dr. Jens Harbott <harbott@osism.tech>
Co-authored-by: Matej Feder <matej.feder@dnation.cloud>
Co-authored-by: Roy Farrell <152626360+PixelPhantomX@users.noreply.github.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants