Implement a stub server printer for CRDs #60269

smarterclayton · 2018-02-23T04:10:17Z

This wires up TableConvertor to CRDs and puts a basic implementation in place for custom paths. However, since our OpenAPISchema can't store OpenAPI extension fields there is no way to expose the custom column piece that get.go supports today (x-kubernetes-print-columns). That piece can be implemented separately and needs discussion.

As this is purely exposing the default interface, very low risk. Will add an e2e test that covers this under a registered CRD.

@soltysh @sttts @kubernetes/sig-api-machinery-pr-reviews

A couple of options for wiring up the actual definition:

add a new "extensions" map to spec.validation
1. Downside: won't handle future child nested fields, not the correct schema
try to change the OpenAPISchema3 field to support extensions
1. Would require a breaking protobuf change, is also very difficult
2. Could store the entire schema as opaque JSON and then parse on load (might be the right thing anyway)
Support this as an annotation in 1.11 - alpha.customresource.k8s.io/x-kubernetes-print-columns like the CLI

Part of #58536

k8s-ci-robot · 2018-02-23T04:10:19Z

@smarterclayton: Adding do-not-merge/release-note-label-needed because the release note process has not been followed.

One of the following labels is required "release-note", "release-note-action-required", or "release-note-none".
Please see: https://git.k8s.io/community/contributors/devel/pull-requests.md#write-release-notes-if-needed.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

smarterclayton · 2018-02-23T16:40:18Z

Given how late we are, and the limitations in existing CRD, i think we'll need to punt custom columns to 1.11. However, this PR enables the default columns so I'd like to get it in (there's no complexity in the core path)

smarterclayton · 2018-02-23T16:40:40Z

@sttts @soltysh @kubernetes/sig-api-machinery-pr-reviews equivalent to #60219

k8s-ci-robot · 2018-02-23T16:47:59Z

@smarterclayton: Adding do-not-merge/release-note-label-needed because the release note process has not been followed.

One of the following labels is required "release-note", "release-note-action-required", or "release-note-none".
Please see: https://git.k8s.io/community/contributors/devel/pull-requests.md#write-release-notes-if-needed.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

soltysh

lgtm

sttts · 2018-02-24T09:06:19Z

staging/src/k8s.io/apiextensions-apiserver/pkg/apiserver/customresource_handler.go

@@ -447,6 +448,11 @@ func (r *crdHandler) getOrCreateServingInfoFor(crd *apiextensions.CustomResource
 		scaleSpec = crd.Spec.Subresources.Scale
 	}

+	table, err := tableconvertor.New(nil)


// TODO: replace the nil with the actual extensions when we support them in OpenAPI validation specs.

sttts · 2018-02-24T09:09:56Z

staging/src/k8s.io/apiextensions-apiserver/pkg/registry/customresource/etcd_test.go

@@ -71,6 +72,8 @@ func newStorage(t *testing.T) (customresource.CustomResourceStorage, *etcdtestin

 	status := &apiextensions.CustomResourceSubresourceStatus{}

+	table, _ := tableconvertor.New(nil)


// TODO: .... as above.

sttts · 2018-02-24T09:19:25Z

.../k8s.io/apiextensions-apiserver/pkg/registry/customresource/tableconvertor/tableconvertor.go

+		cells[1] = age
+		for _, column := range c.columns {
+			if err := column.Execute(buf, obj); err != nil {
+				cells = append(cells, nil)


should be distinguish between not found paths and unprintable data?

Possibly. I think of the current annotation from OpenAPI is underspecified and a bit of a quick hack, so some more thought is deserved for all of this. I was going to propose a 1.11 design extension that covered more of the edge cases - I think given server side printing depends on the CRD, not just OpenAPI, we can do a better job of making this useful. The design goal of CRD is to invert the API model and make clients able to usefully function against a dumb api server, so a better definition (server side smarts) seems logical.

Add the plumbing for server side printing. Not connected until we support a way to get OpenAPI extensions from CRDs.

soltysh

/lgtm

k8s-ci-robot · 2018-02-24T19:06:41Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: smarterclayton, soltysh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~cmd/kubeadm/OWNERS~~ [smarterclayton]
~~pkg/printers/OWNERS~~ [smarterclayton]
~~staging/OWNERS~~ [smarterclayton]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

smarterclayton · 2018-02-24T20:12:25Z

/retest

smarterclayton · 2018-02-24T21:36:02Z

/retest

might be related, although the stack output doesn't help

k8s-ci-robot · 2018-02-24T22:05:18Z

@smarterclayton: The following test failed, say /retest to rerun them all:

Test name	Commit	Details	Rerun command
pull-kubernetes-cross	61b7806cb9f9af16dcf345de6bb129207953e34f	link	`/test pull-kubernetes-cross`

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

smarterclayton · 2018-02-25T00:06:18Z

/retest

weird, passes locally

k8s-github-robot · 2018-02-25T03:31:11Z

/test all [submit-queue is verifying that this PR is safe to merge]

k8s-github-robot · 2018-02-25T04:01:39Z

Automatic merge from submit-queue (batch tested with PRs 60324, 60269, 59771, 60314, 59941). If you want to cherry-pick this change to another branch, please follow the instructions here.

mbohlool · 2018-03-01T21:09:56Z

/sub

sttts · 2018-03-09T17:26:19Z

From Slack:

Stefan Schimanski [18:16] @claytonc which kinds of fields do we have to support? I guess simple json paths .word.word style are enough.
claytonc [18:16]i think anything more complex than that will have problems
we might want to gather feedback
from actual CRDs
like tectonic

Stefan Schimanski [18:17] @claytonc what I don't like about openapi x-kubectl-column style extensions is that with quantors this becomes ambiguous easily
allOf: [someSchemaWithColumns, anotherSchemaWithColumns]
a flat json path list spec.validation sounds more reasonable

claytonc [18:18] i don’t like x-kubectl-columns for a lot of reasons
but yes

sttts · 2018-03-09T17:27:13Z

@brancz can you comment on your requirements for columns?

brancz · 2018-03-10T12:26:01Z

For us simple json paths would definitely suffice for tables/columns.

Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>. apiextensions-apiserver: add columns to CRD spec Follow-up of #60269. ```release-note Add spec. additionalPrinterColumns to CRDs to define server side printing columns. ```

Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>. apiextensions-apiserver: add columns to CRD spec Follow-up of kubernetes/kubernetes#60269. ```release-note Add spec. additionalPrinterColumns to CRDs to define server side printing columns. ``` Kubernetes-commit: 34383aa0a49ab916d74ea897cebc79ce0acfc9dd

k8s-ci-robot requested review from dmmcquay, enisoc, ghodss, lavalamp, markturansky, nikhiljindal and thockin February 23, 2018 04:10

smarterclayton mentioned this pull request Feb 23, 2018

Bringing server-side printing to beta summary #58536

Closed

16 tasks

smarterclayton force-pushed the crd_printing branch 2 times, most recently from 61b7806 to b336053 Compare February 23, 2018 04:32

smarterclayton added release-note-none Denotes a PR that doesn't merit a release note. and removed do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. labels Feb 23, 2018

smarterclayton force-pushed the crd_printing branch from b336053 to 97d5992 Compare February 23, 2018 16:39

smarterclayton force-pushed the crd_printing branch from 97d5992 to b8cc51f Compare February 23, 2018 16:46

k8s-ci-robot added do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. and removed release-note-none Denotes a PR that doesn't merit a release note. labels Feb 23, 2018

smarterclayton added release-note-none Denotes a PR that doesn't merit a release note. and removed do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. labels Feb 23, 2018

soltysh approved these changes Feb 23, 2018

View reviewed changes

soltysh added this to the v1.10 milestone Feb 23, 2018

smarterclayton force-pushed the crd_printing branch from b8cc51f to eaa90b5 Compare February 23, 2018 19:56

sttts reviewed Feb 24, 2018

View reviewed changes

CRD should have server side printing

fb6b1c0

Add the plumbing for server side printing. Not connected until we support a way to get OpenAPI extensions from CRDs.

smarterclayton force-pushed the crd_printing branch from d10f558 to fb6b1c0 Compare February 24, 2018 18:44

k8s-ci-robot assigned soltysh Feb 24, 2018

k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 24, 2018

soltysh approved these changes Feb 24, 2018

View reviewed changes

k8s-ci-robot added status/approved-for-milestone and removed approved-for-milestone labels Feb 24, 2018

k8s-github-robot merged commit 0f9b5e9 into kubernetes:master Feb 25, 2018

juanvallejo mentioned this pull request Mar 2, 2018

Server-side printing continued #60712

Closed

12 tasks

sttts mentioned this pull request Mar 9, 2018

Generate OpenAPI spec for registered CRDs #58603

Closed

sttts mentioned this pull request Mar 9, 2018

apiextensions-apiserver: add columns to CRD spec #60991

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Implement a stub server printer for CRDs #60269

Implement a stub server printer for CRDs #60269

smarterclayton commented Feb 23, 2018 •

edited

k8s-ci-robot commented Feb 23, 2018

smarterclayton commented Feb 23, 2018

smarterclayton commented Feb 23, 2018

k8s-ci-robot commented Feb 23, 2018

soltysh left a comment

sttts Feb 24, 2018

sttts Feb 24, 2018

sttts Feb 24, 2018

smarterclayton Feb 24, 2018

soltysh left a comment

k8s-ci-robot commented Feb 24, 2018

smarterclayton commented Feb 24, 2018

smarterclayton commented Feb 24, 2018

k8s-ci-robot commented Feb 24, 2018 •

edited

smarterclayton commented Feb 25, 2018

k8s-github-robot commented Feb 25, 2018

k8s-github-robot commented Feb 25, 2018

mbohlool commented Mar 1, 2018

sttts commented Mar 9, 2018

sttts commented Mar 9, 2018

brancz commented Mar 10, 2018 •

edited

		@@ -71,6 +72,8 @@ func newStorage(t testing.T) (customresource.CustomResourceStorage, etcdtestin

		status := &apiextensions.CustomResourceSubresourceStatus{}

		table, _ := tableconvertor.New(nil)

Implement a stub server printer for CRDs #60269

Implement a stub server printer for CRDs #60269

Conversation

smarterclayton commented Feb 23, 2018 • edited

k8s-ci-robot commented Feb 23, 2018

smarterclayton commented Feb 23, 2018

smarterclayton commented Feb 23, 2018

k8s-ci-robot commented Feb 23, 2018

soltysh left a comment

Choose a reason for hiding this comment

sttts Feb 24, 2018

Choose a reason for hiding this comment

sttts Feb 24, 2018

Choose a reason for hiding this comment

sttts Feb 24, 2018

Choose a reason for hiding this comment

smarterclayton Feb 24, 2018

Choose a reason for hiding this comment

soltysh left a comment

Choose a reason for hiding this comment

k8s-ci-robot commented Feb 24, 2018

smarterclayton commented Feb 24, 2018

smarterclayton commented Feb 24, 2018

k8s-ci-robot commented Feb 24, 2018 • edited

smarterclayton commented Feb 25, 2018

k8s-github-robot commented Feb 25, 2018

k8s-github-robot commented Feb 25, 2018

mbohlool commented Mar 1, 2018

sttts commented Mar 9, 2018

sttts commented Mar 9, 2018

brancz commented Mar 10, 2018 • edited

smarterclayton commented Feb 23, 2018 •

edited

k8s-ci-robot commented Feb 24, 2018 •

edited

brancz commented Mar 10, 2018 •

edited