[installer-tests] Test K3s with different Ubuntu versions #10600
Labels
aspect: testing
Anything related to testing Gitpod manually, automated integration tests or even unit tests
team: delivery
Issue belongs to the self-hosted team
Is your feature request related to a problem? Please describe
Test automation uses a specific Ubuntu image.
Describe the behaviour you'd like
It would be nice to test many versions of Ubuntu.
Why? We currently support 18.04, and 20.04, and are running 22.04 on the saas.
What if 18 or 20 break? We won't know (easily) unless a self-hosted customer tells us, because the saas is on 22.
Ideally we'd be able to include other variables too, for more complex permutations, like Kubernetes and containerd versions. But I think we need to be careful in how many permutations we take one...it'll quickly grow out of control.
Describe alternatives you've considered
Right now the version is stored in a file, and triggered via werft. Perhaps we can provide for the ability to override some values at runtime?
Additional context
The product compatibility matrix [internal] has many combinations. We should pick the highest risk variables and invest in related test automation.
The text was updated successfully, but these errors were encountered: