[FEED] Integration Tests Rework

[robin-checkmk]

Provide your feedback

We currently have integration tests for:

• Modules
• The server role

For the agent role it was not possible to get something up and running in a reasonable amount of time.
All of the abovementioned integration tests show some level of flakiness. This is - as far as I can tell - related to installing Checkmk into container images not made for it. More specifically, a lot of issues point towards systemd.
In my current opinion we need full-fledged VMs to properly test all aspects of the collection. Obviously this is something we have to do on our own, but which is far from trivial.

So this issue is more of a note to everyone reading this, that the integration test are not in the best shape.
We try to keep them as useful as possible, without wasting too much time.

Component Name

• All modules
• All roles

Ansible Version

$ ansible --version

Collection Version

$ ansible-galaxy collection list

Environment

• Local Docker
• Github Actions

Screenshots

Additional context

[robin-checkmk]

Update: Current flakiness seems to be resolved for now. It might have been an update to the Ansible Testing Containers, but I cannot tell right now.

[robin-checkmk]

Related issues for molecule tests:

• Molecule throws error during gather_facts : Failed to create temporary directory geerlingguy/docker-ubuntu2204-ansible#6
• systemctl not working in container - 'Failed to connect to bus: No such file or directory' geerlingguy/docker-fedora27-ansible#2

[github-actions]

This issue has been stale for 60 days. It will close in 7 days.

[robin-checkmk]

All flakiness is gone for some time now. So I will close this issue once #323 is merged.