New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conformance testing #95

Open
squeed opened this Issue Jan 26, 2017 · 3 comments

Comments

Projects
None yet
4 participants
@squeed
Collaborator

squeed commented Jan 26, 2017

74 tests passed, 20 failed:

  • Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogOnError is set (test/e2e_node/runtime_conformance_test.go:232) -> #102

  • EmptyDir volumes [It] should support (non-root,0666,tmpfs) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message if TerminationMessagePath is set as non-root user and at a non-default path [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> #102

  • EmptyDir volumes [It] should support (non-root,0777,tmpfs) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • EmptyDir volumes [It] should support (non-root,0777,default) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • Kubelet when scheduling a read only busybox container [It] it should not write to root filesystem [Conformance] (test/e2e_node/kubelet_test.go:151) --> kubernetes/kubernetes#40529

  • Probing container [It] should be restarted with a exec "cat /tmp/health" liveness probe [Conformance] (test/e2e/common/container_probe.go:404) -> #99

  • EmptyDir volumes [It] should support (non-root,0644,default) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • Secrets [It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • ConfigMap [It] should be consumable from pods in volume as non-root [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • EmptyDir volumes [It] should support (non-root,0666,default) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • ConfigMap [It] should be consumable from pods in volume with mappings as non-root [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message from file when pod succeeds and TerminationMessagePolicy FallbackToLogOnError is set [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> #102

  • Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message from log output if TerminationMessagePolicy FallbackToLogOnError is set [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> #102

  • Docker Containers [It] should be able to override the image's default arguments (docker cmd) [Conformance] (test/e2e/framework/util.go:2103) --> rkt/rkt#3566

  • EmptyDir volumes [It] should support (non-root,0644,tmpfs) [Conformance] [Volume] (test/e2e/framework/util.go:2103)

  • Container Lifecycle Hook when create a pod with lifecycle hook when it is exec hook [It] should execute prestop exec hook properly [Conformance] (test/e2e/framework/pods.go:176)

  • Container Runtime Conformance Test container runtime conformance blackbox test when starting a container that exits [It] should report termination message if TerminationMessagePath is set [Conformance] (test/e2e_node/runtime_conformance_test.go:232) -> #102

  • MirrorPod when create a mirror pod [It] should be updated when static pod updated [Conformance] (test/e2e_node/mirror_pod_test.go:73)

  • Container Runtime Conformance Test container runtime conformance blackbox test when running a container with a new image [It] should be able to pull from private registry with secret [Conformance] (test/e2e_node/runtime_conformance_test.go:384)

@lucab

This comment has been minimized.

Collaborator

lucab commented Jan 27, 2017

Most of those seems to be coming from the mounttest image having quirky permissions on the entrypoint binary:

-rwxr-x--- 1 root root 2052704 May 19  2016 mt
@squeed

This comment has been minimized.

Collaborator

squeed commented Feb 8, 2017

Now 89 passing, 5 failed:

  • Secrets [It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [Conformance] [Volume] /test/e2e/framework/util.go:2113
  • ConfigMap [It] should be consumable from pods in volume with mappings as non-root [Conformance] [Volume] /test/e2e/framework/util.go:2113
  • Downward API volume [It] should update annotations on modification [Conformance] [Volume] /test/e2e/common/downwardapi_volume.go:153
  • ConfigMap [It] should be consumable from pods in volume as non-root [Conformance] [Volume] /test/e2e/framework/util.go:2113
  • blackbox test when running a container with a new image [It] should be able to pull from private registry with secret [Conformance] test/e2e_node/runtime_conformance_test.go:384
@iaguis

This comment has been minimized.

Collaborator

iaguis commented Nov 15, 2017

Version v1.9.0-alpha.2.328+d07bc1485cddc9

Now 129 passing, 16 failed:

  • Guestbook application [It] should create and stop a working application [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:1772
  • Update Demo [It] should do a rolling update of a replication controller [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
  • HostPath [It] should give a volume the correct mode [Conformance] [Volume] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2252
  • Kubectl client [k8s.io] Kubectl label [BeforeEach] should update the label on a resource [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:969
  • Kubectl client [k8s.io] Update Demo [It] should scale a replication controller [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
  • Kubectl client [k8s.io] Kubectl describe [It] should check if kubectl describe prints relevant information for rc and pods [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/kubectl.go:1679
  • Downward API volume [It] should provide podname only [Conformance] [Volume] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:148
  • Kubectl client [k8s.io] Update Demo [It] should create and stop a replication controller [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
  • Networking [It] should provide Internet connection for containers [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/networking.go:50
  • Kubectl client [k8s.io] Kubectl run --rm job [It] should create a job from an image, then delete the job [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2152
  • Networking [k8s.io] Granular Checks: Pods [It] should function for intra-pod communication: udp [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/networking_utils.go:217
  • DNS [It] should provide DNS for services [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/dns.go:175
  • Projected [It] should project all components that make up the projection API [Conformance] [Volume] [Projection] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2252
  • Networking [k8s.io] Granular Checks: Pods [It] should function for intra-pod communication: http [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/networking_utils.go:217
  • Kubectl client [k8s.io] Kubectl rolling-update [It] should support rolling-update to same image [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2070
  • PreStop [It] should call prestop when killing a pod [Conformance] /home/iaguis/work/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/pre_stop.go:171

@iaguis iaguis added this to the v0.3.0 milestone Nov 15, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment