Conformance testing

[squeed]

74 tests passed, 20 failed:

• Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogOnError is set (test/e2e_node/runtime_conformance_test.go:232) -> rktlet/mounts: support for terminationMessagePath #102

• EmptyDir volumes [It] should support (non-root,0666,tmpfs) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message if TerminationMessagePath is set as non-root user and at a non-default path [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> rktlet/mounts: support for terminationMessagePath #102

• EmptyDir volumes [It] should support (non-root,0777,tmpfs) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• EmptyDir volumes [It] should support (non-root,0777,default) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• Kubelet when scheduling a read only busybox container [It] it should not write to root filesystem [Conformance] (test/e2e_node/kubelet_test.go:151) --> test/e2e_node: tie together expected string and exec kubernetes/kubernetes#40529

• Probing container [It] should be restarted with a exec "cat /tmp/health" liveness probe [Conformance] (test/e2e/common/container_probe.go:404) -> runtime/exec: do not mix errors and status codes #99

• EmptyDir volumes [It] should support (non-root,0644,default) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• Secrets [It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• ConfigMap [It] should be consumable from pods in volume as non-root [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• EmptyDir volumes [It] should support (non-root,0666,default) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• ConfigMap [It] should be consumable from pods in volume with mappings as non-root [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message from file when pod succeeds and TerminationMessagePolicy FallbackToLogOnError is set [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> rktlet/mounts: support for terminationMessagePath #102

• Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message from log output if TerminationMessagePolicy FallbackToLogOnError is set [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> rktlet/mounts: support for terminationMessagePath #102

• Docker Containers [It] should be able to override the image's default arguments (docker cmd) [Conformance] (test/e2e/framework/util.go:2103) --> stage0/app-add: CLI args should override image ones rkt/rkt#3566

• EmptyDir volumes [It] should support (non-root,0644,tmpfs) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

• Container Lifecycle Hook when create a pod with lifecycle hook when it is exec hook [It] should execute prestop exec hook properly [Conformance] (test/e2e/framework/pods.go:176)

• Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message if TerminationMessagePath is set [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> rktlet/mounts: support for terminationMessagePath #102

• MirrorPod when create a mirror pod [It] should be updated when static pod updated [Conformance] (test/e2e_node/mirror_pod_test.go:73)

• Container Runtime Conformance Test container runtime conformance blackbox test when running a container with a new image [It] should be able to pull from private registry with secret [Conformance] (test/e2e_node/runtime_conformance_test.go:384)

[lucab]

Most of those seems to be coming from the mounttest image having quirky permissions on the entrypoint binary:

-rwxr-x--- 1 root root 2052704 May 19  2016 mt

[squeed]

Now 89 passing, 5 failed:

• Secrets [It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [Conformance] [Volume] /test/e2e/framework/util.go:2113
• ConfigMap [It] should be consumable from pods in volume with mappings as non-root [Conformance] [Volume] /test/e2e/framework/util.go:2113
• Downward API volume [It] should update annotations on modification [Conformance] [Volume] /test/e2e/common/downwardapi_volume.go:153
• ConfigMap [It] should be consumable from pods in volume as non-root [Conformance] [Volume] /test/e2e/framework/util.go:2113
• blackbox test when running a container with a new image [It] should be able to pull from private registry with secret [Conformance] test/e2e_node/runtime_conformance_test.go:384

[iaguis]

Version v1.9.0-alpha.2.328+d07bc1485cddc9

Now 129 passing, 16 failed:

• Guestbook application [It] should create and stop a working application [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:1772
• Update Demo [It] should do a rolling update of a replication controller [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
• HostPath [It] should give a volume the correct mode [Conformance] [Volume] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2252
• Kubectl client [k8s.io] Kubectl label [BeforeEach] should update the label on a resource [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:969
• Kubectl client [k8s.io] Update Demo [It] should scale a replication controller [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
• Kubectl client [k8s.io] Kubectl describe [It] should check if kubectl describe prints relevant information for rc and pods [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:1679
• Downward API volume [It] should provide podname only [Conformance] [Volume] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:148
• Kubectl client [k8s.io] Update Demo [It] should create and stop a replication controller [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
• Networking [It] should provide Internet connection for containers [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/networking.go:50
• Kubectl client [k8s.io] Kubectl run --rm job [It] should create a job from an image, then delete the job [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2152
• Networking [k8s.io] Granular Checks: Pods [It] should function for intra-pod communication: udp [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/networking_utils.go:217
• DNS [It] should provide DNS for services [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/dns.go:175
• Projected [It] should project all components that make up the projection API [Conformance] [Volume] [Projection] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2252
• Networking [k8s.io] Granular Checks: Pods [It] should function for intra-pod communication: http [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/networking_utils.go:217
• Kubectl client [k8s.io] Kubectl rolling-update [It] should support rolling-update to same image [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
• PreStop [It] should call prestop when killing a pod [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/pre_stop.go:171

[fejta-bot]

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

[fejta-bot]

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle rotten

[fejta-bot]

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close

[k8s-ci-robot]

@fejta-bot: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.