Missing conformance docs for 1.10 and 1.11

[spiffxp]

We have https://github.com/cncf/k8s-conformance/blob/master/docs/KubeConformance-1.9.md but not the 1.10 and 1.11 variants.

ref: #109

I am interested in how these are generated in whether it can be automated so I'll be taking a crack at this.

[lachie83]

I would also like to suggest we version pin sonobuoy-conformance.yaml in the root dir of the repo. eg sonobuoy-conformance-1.10.yaml

[spiffxp]

I can't seem to find any docs for how these were generated but I think I found the PR that added the code. Things are hardcoded. Generating them today would require some manual hacking around. I will start there and see how we can iterate

[brahmaroutu]

#279
#280
Also conformance document is generated using the following step for v1.11 tag.
checkout v1.11
go run test/conformance/walk.go --conformance --url https://github.com/kubernetes/kubernetes/tree/v1.11.0 test

note that url is currently supplied.

[timothysc]

So this work was originally intended to be autogenerated and published with the main docs for every release.

[spiffxp]

Thus far it hasn't worked out that way. I haven't been able to dig up a tracking issue for this intention. The code is currently locked into k/k, it would be useful to see if there's a way this could be an out-of-tree tool, but at this point I'll take whatever we can get.

[timothysc]

The IBM folks, namely @brahmaroutu , we're leading that effort.

[PatrickLang]

v1.13 too. This is part of what I was asking about at Kubecon - I'm hoping I can refer users to a list of test cases without having to build and run the test tools themselves.

[hh]

#622 Ready for Review / Merging

[hh]

/close
This is merged!