Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

24-hour test history is misleading when entire test suite fails #428

Closed
bgrant0607 opened this issue Aug 22, 2016 · 3 comments
Closed

24-hour test history is misleading when entire test suite fails #428

bgrant0607 opened this issue Aug 22, 2016 · 3 comments

Comments

@bgrant0607
Copy link
Member

http://storage.googleapis.com/kubernetes-test-history/static/index.html

shows 78 tests passed, 0 failed, 0 unstable, 0 broken for this suite:

78  0   kubernetes-e2e-gke-1.2-1.3-upgrade-cluster-new 2    2   0   0

but only 2 tests.

In fact, the whole suite has been failing for weeks. The only thing working has been gcloud installation.

https://k8s-testgrid.appspot.com/google-upgrade#gke-1.2-1.3-upgrade-cluster-new&width=3

@spxtr
Copy link
Contributor

spxtr commented Aug 22, 2016

It only calls it a failure if there is a test failure. We should probably fix that so that it looks at finished.json, although I think we might be trying to move away from the 24-hour view sometime soon. @rmmh might have an opinion.

@bgrant0607
Copy link
Member Author

@spxtr I noticed this when looking at ways we could have noticed that the upgrade tests started failing back in June. Given the number of tests and test suites, some kind of summary seems like it would be useful, whether it's this current page or some other format.

@fejta
Copy link
Contributor

fejta commented May 17, 2017

The traige dashboard and testgrid deprecated this site.

@fejta fejta closed this as completed May 17, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants