Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

kubernetes-verify-master: broken test run #31191

Closed
k8s-github-robot opened this issue Aug 22, 2016 · 36 comments
Closed

kubernetes-verify-master: broken test run #31191

k8s-github-robot opened this issue Aug 22, 2016 · 36 comments
Assignees
@rmmh
Labels
area/test-infra kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.

Comments

@k8s-github-robot
Copy link

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3178/

Run so broken it didn't make JUnit output!
@k8s-github-robot k8s-github-robot added priority/backlog Higher priority than priority/awaiting-more-evidence. area/test-infra kind/flake Categorizes issue or PR as related to a flaky test. labels Aug 22, 2016
@fejta
Copy link
Contributor

fejta commented Aug 23, 2016

Looks like some intermittent networking problems:

fatal: git fetch_pack: expected ACK/NAK, got 'ERR Internal Server Error'
fatal: The remote end hung up unexpectedly
godep: error downloading dep (google.golang.org/api/googleapi/internal/uritemplates): exit status 128
godep: Error downloading some deps. Aborting restore and check.
Removing /tmp/gopath.8OlUZU
FAILED   hack/make-rules/../../hack/verify-godeps.sh    228s

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3283/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3287/

Run so broken it didn't make JUnit output!

@k8s-github-robot k8s-github-robot added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed priority/backlog Higher priority than priority/awaiting-more-evidence. labels Aug 26, 2016
@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3290/

Run so broken it didn't make JUnit output!

@k8s-github-robot k8s-github-robot added priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. and removed priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Aug 26, 2016
@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3343/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention...

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3487/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3493/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3494/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3495/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

2 similar comments
@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

@k8s-github-robot
Copy link
Author

[FLAKE-PING] @apelisse

This flaky-test issue would love to have more attention.

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3665/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3666/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3667/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3668/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3718/

Run so broken it didn't make JUnit output!

@ixdy
Copy link
Member

ixdy commented Sep 6, 2016 •
edited

3178: git clone failed in verify-godeps.sh
3283: slow git checkout
3287: another godep dependency download failure
3290: slow git checkout
3343: slow git checkout
3487: etcd download timed out
3493: etcd download timed out
3494: etcd download timed out
3495: etcd download timed out
3665 - 8: legitimate gofmt failure (broken by #32076)
3718: looks like mungedocs might be broken (by #31794)

@ixdy
Copy link
Member

ixdy commented Sep 6, 2016

mungedocs probably not broken by that PR, but I'm not sure of root cause yet. could be a flaky check.

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3719/

Run so broken it didn't make JUnit output!

@ixdy ixdy mentioned this issue Sep 6, 2016
Closed
@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3720/

Run so broken it didn't make JUnit output!

rmmh pushed a commit to rmmh/kubernetes that referenced this issue Sep 7, 2016
Automatically cache etcd releases on GCS, to avoid triggering 403s fr…
fb170b0 
…om S3.

This has been causing flakes: kubernetes#31191, kubernetes#31492

This includes a hash of the tarball to ensure that the correct file is
downloaded, either from GCS or S3.

Tested manually with:

    ( . hack/lib/init.sh; kube::etcd::install )
    gsutil rm gs://kubernetes-jenkins/dependencies/etcd/etcd-v3.0.4-linux-amd64.tar.gz
@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3721/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3722/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3723/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3724/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3725/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3726/

Run so broken it didn't make JUnit output!

@ixdy ixdy assigned rmmh and unassigned apelisse Sep 7, 2016
@ixdy
Copy link
Member

ixdy commented Sep 7, 2016

Reassign to @rmmh since he's working on etcd download caching.

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3784/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3785/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3786/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3787/

Run so broken it didn't make JUnit output!

@k8s-github-robot
Copy link
Author

Failed: https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/kubernetes-verify-master/3788/

Run so broken it didn't make JUnit output!

@rmmh
Copy link
Contributor

rmmh commented Sep 8, 2016

^ These 5 are all from a pull that broke verify-munge-docs. It shouldn't recur since kubernetes/test-infra#536 was merged.

@rmmh rmmh mentioned this issue Sep 8, 2016
Closed
@rmmh
Copy link
Contributor

rmmh commented Sep 8, 2016

Closing because the sub-issues have been fixed. Let's track the etcd flakes separately.

@rmmh rmmh closed this as completed Sep 8, 2016
rmmh pushed a commit to rmmh/kubernetes that referenced this issue Feb 28, 2017
Automatically cache etcd releases on GCS, to avoid triggering 403s fr…
1c2d175 
…om S3.

This has been causing flakes: kubernetes#31191, kubernetes#31492

This includes a hash of the tarball to ensure that the correct file is
downloaded, either from GCS or S3.

Tested manually with:

    ( . hack/lib/init.sh; kube::etcd::install )
    gsutil rm gs://kubernetes-jenkins/dependencies/etcd/etcd-v3.0.4-linux-amd64.tar.gz
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rmmh rmmh

Labels
area/test-infra kind/flake Categorizes issue or PR as related to a flaky test. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@rmmh @fejta @apelisse @ixdy @k8s-github-robot