Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration test command should run all integration tests #1738

Merged
merged 2 commits into from
Nov 24, 2020

Conversation

alenkacz
Copy link
Contributor

We agreed on this with Andreas here https://kubernetes.slack.com/archives/CG3HTFCMV/p1603361976115700?thread_ts=1603360951.111500&cid=CG3HTFCMV

Context: There was a PR that has splitted KUTTL tests out of integration-test command. The reason was to be easily able to run just a single test. But as a result, command that's named integration-test now runs only a subset of integration tests and I think that's very confusing. The solution is to keep kuttl test separate for whoever needs it but have all integration tests again under one makefile command.

Signed-off-by: Alena Varkockova <varkockova.a@gmail.com>

echo "Running KUTTL integration tests"

./hack/run-kuttl-tests.sh
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be better to have this called from the script location and not assume where it is called from... but non-blocking

@kensipe
Copy link
Member

kensipe commented Nov 16, 2020

I prefer to think of "integration" as Go integration tests... and kuttl as mainly e2e tests. this blurs that.

@alenkacz
Copy link
Contributor Author

@kensipe yeah I see how that can be confusing but these tests are really integration tests (and yes, we have kuttl e2e tests as well)

I would actually say that for kuttl integration and e2e are on the same level, it just depends whether you use startControlPlane flag or not (if yes, you're doing integration not e2e in the sense it's commonly defined)

Signed-off-by: Alena Varkockova <alenavarkockova@10.0.0.15>
@alenkacz alenkacz merged commit 2e8d881 into main Nov 24, 2020
@alenkacz alenkacz deleted the av/integration-test branch November 24, 2020 12:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants