Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unable to deploy database in e2e test: secret never got mounted #9775

Closed
smarterclayton opened this issue Jul 11, 2016 · 5 comments
Closed

Unable to deploy database in e2e test: secret never got mounted #9775

smarterclayton opened this issue Jul 11, 2016 · 5 comments
Assignees
@ncdc
Labels
component/storage kind/test-flake Categorizes issue or PR as related to test flakes. priority/P0

Comments

@smarterclayton
Copy link
Contributor

Post Rebase (kube 1.3.0) on our RHEL 7.2 CI machines some deployments are failing because they are unable to mount a secret occasionally.

https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_integration/3091/
https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_integration/3091/s3/download/test-end-to-end-docker/logs/container-origin.log

Opened kubernetes/kubernetes#28750
@smarterclayton smarterclayton added kind/test-flake Categorizes issue or PR as related to test flakes. priority/P0 component/storage labels Jul 11, 2016
@ncdc ncdc mentioned this issue Jul 11, 2016
Closed
This was referenced Jul 12, 2016
Merged
Merged
@0xmichalis 0xmichalis mentioned this issue Jul 12, 2016
Merged
@deads2k
Copy link
Contributor

deads2k commented Jul 13, 2016 •
edited by stevekuznetsov
Loading 

test/end-to-end/core.sh:21: executing 'oc get -n test pods -l name=database' expecting any result and text 'Running'

The linked issue was closed, so I'm adding this so people can find it. Hit it again.

https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_integration/3270

@smarterclayton
Copy link
Contributor Author

This is because identical volumes are mounted in serial per node, and since the same secret is used multiple times on the same node for different pods all of those pod starts are serialized. There appears to be a detach issues as well potentially (which may exacerbate the problem here).

@smarterclayton
Copy link
Contributor Author

Issue is being worked and slated for 1.3 backport.

@0xmichalis 0xmichalis mentioned this issue Jul 14, 2016
Merged
@bparees
Copy link
Contributor

bparees commented Jul 14, 2016

think i hit what @deads2k referenced again here:
https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_integration/3342/consoleFull

@bparees bparees mentioned this issue Jul 14, 2016
Merged
This was referenced Jul 14, 2016
Closed
Merged
@0xmichalis 0xmichalis mentioned this issue Jul 20, 2016
Merged
@deads2k deads2k mentioned this issue Jul 21, 2016
Merged
This was referenced Jul 22, 2016
Merged
Merged
@danwinship danwinship mentioned this issue Jul 22, 2016
Merged
This was referenced Jul 26, 2016
Merged
Closed
@miminar miminar mentioned this issue Jul 29, 2016
Merged
This was referenced Jul 29, 2016
Merged
Merged
@csrwng csrwng mentioned this issue Jul 31, 2016
Merged
@stevekuznetsov stevekuznetsov mentioned this issue Aug 1, 2016
Merged
@danwinship danwinship mentioned this issue Aug 1, 2016
Merged
@soltysh soltysh mentioned this issue Aug 2, 2016
Merged
@smarterclayton
Copy link
Contributor Author

Now resolved

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ncdc ncdc

Labels
component/storage kind/test-flake Categorizes issue or PR as related to test flakes. priority/P0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ncdc @smarterclayton @bparees @deads2k