VM creation using yaml or web-ui fails with service: "fake-validation-service" not found

[dhiller]

Installed latest HCO on OpenShift 4.2 master. Using the vmi.yaml from kubevirt docs I tried to create a virtual machine instance:

$ kubectl create -f vmi.yaml 
Error from server (InternalError): error when creating "vmi.yaml": Internal error occurred: failed calling webhook "virtualmachineinstances.kubevirt.io-tmp-validator": Post https://fake-validation-service.kubevirt-hyperconverged.svc:443/fake-path/virtualmachineinstances.kubevirt.io?timeout=30s: service "fake-validation-service" not found

Later on created a VM template from web-ui, tried to create a VMI using the template and got this error from ui:

Error "failed calling webhook "virtualmachines.kubevirt.io-tmp-validator": Post https://fake-validation-service.kubevirt-hyperconverged.svc:443/fake-path/virtualmachines.kubevirt.io?timeout=30s: service "fake-validation-service" not found" for field "undefined".

[dhiller]

$ kubectl logs -n kubevirt-hyperconverged virt-operator-8fd6c4c4c-wd4mq
{"component":"virt-operator","kind":"","level":"error","msg":"Failed to create all resources: unable to create clusterrole \u0026ClusterRole{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kubevirt.io:admin,GenerateName:,Namespace:,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:\u003cnil\u003e,Delet
ionGracePeriodSeconds:nil,Labels:map[string]string{app.kubernetes.io/managed-by: kubevirt-operator,kubevirt.io: ,rbac.authorization.k8s.io/aggregate-to-admin: true,},Annotations:map[string]string{kubevirt.io/install-strategy-registry: kubevirt,kubevirt.io/install-strategy-version: latest,},OwnerReferences:[{kubevirt.io/v1alpha3 KubeVirt kubevirt-hyperconverged-cluster 6c610378-
9975-11e9-bb35-525400aebce6 0xc00122581b 0xc00122581a}],Finalizers:[],ClusterName:,Initializers:nil,},Rules:[{[get] [subresources.kubevirt.io] [virtualmachineinstances/console virtualmachine
instances/vnc] [] []} {[update] [subresources.kubevirt.io] [virtualmachines/start virtualmachines/stop virtualmachines/restart] [] []} {[get delete create update patch list watch deletecolle
ction] [kubevirt.io] [virtualmachines virtualmachineinstances virtualmachineinstancepresets virtualmachineinstancereplicasets virtualmachineinstancemigrations] [] []}],AggregationRule:nil,}:
 clusterroles.rbac.authorization.k8s.io \"kubevirt.io:admin\" is forbidden: user \"system:serviceaccount:kubevirt-hyperconverged:kubevirt-operator\" (groups=[\"system:serviceaccounts\" \"sys
tem:serviceaccounts:kubevirt-hyperconverged\" \"system:authenticated\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"subresources.kubevirt.io\"], Resources:[\"
virtualmachines/start\"], Verbs:[\"update\"]}\n{APIGroups:[\"subresources.kubevirt.io\"], Resources:[\"virtualmachines/stop\"], Verbs:[\"update\"]}","name":"kubevirt-hyperconverged-cluster",
"namespace":"kubevirt-hyperconverged","pos":"kubevirt.go:875","timestamp":"2019-06-28T09:22:03.997389Z","uid":"6c610378-9975-11e9-bb35-525400aebce6"}
$ kubectl get pods -n kubevirt-hyperconverged                                                                                                                                         130 ↵
NAME                                              READY   STATUS    RESTARTS   AGE
cdi-apiserver-799b86cd47-tgnpb                    1/1     Running   0          121m
cdi-deployment-67855b764d-lt6sq                   1/1     Running   0          121m
cdi-operator-86cfbc4f55-lkhp2                     1/1     Running   0          123m
cdi-uploadproxy-7cd5bdb789-c6kwj                  1/1     Running   0          121m
cluster-network-addons-operator-c78d4f6fc-67n7t   1/1     Running   0          123m
hyperconverged-cluster-operator-d6c986564-hggbz   1/1     Running   0          123m
kubevirt-node-labeller-6tzdx                      0/1     Pending   0          121m
kubevirt-ssp-operator-c4cd5f564-7rkln             1/1     Running   0          123m
kubevirt-web-ui-operator-59f778956-bgxxh          1/1     Running   0          123m
node-maintenance-operator-6b6d5756d8-ht52l        1/1     Running   0          123m
virt-operator-8fd6c4c4c-wd4mq                     1/1     Running   0          123m
virt-operator-8fd6c4c4c-z5m64                     1/1     Running   0          123m
virt-template-validator-54895c469-l2974           1/1     Running   0          121m

[dhiller]

virt-operator-8fd6c4c4c-wd4mq.log

[rthallisey]

HCO is using kubevirt v0.17.0 on the master branch. Latest release is v0.17.4 and master is v0.18.1. Working on updating.

[slintes]

just for completeness, this is what happend:

• HCO on master branch was using old KubeVirt manifests, which miss some new RBAC rules
• that prevented creating virt-api deployment
• when there is no healthy virt-api deployment, the operator creates a fake admission webhook, which just rejects all VMs, because there is no virt-api wich could validate them

[dhiller]

@rthallisey Figuring that the merge of #145 should have fixed my problem I tried again today, this time on kubevirtci with okd-4.1, and got a very similar error.

$ cluster-up/kubectl.sh logs -n kubevirt-hyperconverged virt-operator-667b6c845d-4n9h6 | tail -n 1 | jq '.'
{
  "component": "virt-operator",
  "kind": "",
  "level": "error",
  "msg": "Failed to create all resources: unable to create clusterrole &ClusterRole{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kubevirt.io:admin,GenerateName:,Namespace:
,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{app.kubernetes.i
o/managed-by: kubevirt-operator,kubevirt.io: ,rbac.authorization.k8s.io/aggregate-to-admin: true,},Annotations:map[string]string{kubevirt.io/install-strategy-registry: kubevirt,kubevirt.io/i
nstall-strategy-version: latest,},OwnerReferences:[{kubevirt.io/v1alpha3 KubeVirt kubevirt-hyperconverged-cluster 8be83fc3-9c97-11e9-b2f7-664f163f5f0f 0xc000fcaefb 0xc000fcaefa}],Finalizers:
[],ClusterName:,Initializers:nil,},Rules:[{[get] [subresources.kubevirt.io] [virtualmachineinstances/console virtualmachineinstances/vnc] [] []} {[update] [subresources.kubevirt.io] [virtual
machines/start virtualmachines/stop virtualmachines/restart] [] []} {[get delete create update patch list watch deletecollection] [kubevirt.io] [virtualmachines virtualmachineinstances virtu
almachineinstancepresets virtualmachineinstancereplicasets virtualmachineinstancemigrations] [] []}],AggregationRule:nil,}: clusterroles.rbac.authorization.k8s.io \"kubevirt.io:admin\" is fo
rbidden: user \"system:serviceaccount:kubevirt-hyperconverged:kubevirt-operator\" (groups=[\"system:serviceaccounts\" \"system:serviceaccounts:kubevirt-hyperconverged\" \"system:authenticate
d\"]) is attempting to grant RBAC permissions not currently held:\n{APIGroups:[\"subresources.kubevirt.io\"], Resources:[\"virtualmachines/start\"], Verbs:[\"update\"]}\n{APIGroups:[\"subres
ources.kubevirt.io\"], Resources:[\"virtualmachines/stop\"], Verbs:[\"update\"]}",
  "name": "kubevirt-hyperconverged-cluster",
  "namespace": "kubevirt-hyperconverged",
  "pos": "kubevirt.go:875",
  "timestamp": "2019-07-02T07:37:53.702776Z",
  "uid": "8be83fc3-9c97-11e9-b2f7-664f163f5f0f"
}

Digging into the operator.yaml I found a v0.17 there:

            ...
            - name: VIRT_LAUNCHER_TAG
              value: v0.17.0
            ...

Isn't this supposed to be updated?

Furthermore a grep found a couple more:

$ find . -type f | xargs grep '0\.17'
./deploy/converged/ssp-op:              value: v0.17.0
./deploy/converged/operator.yaml:              value: v0.17.0
./deploy/converged/olm-catalog/kubevirt-hyperconverged/0.0.1/kubevirt-hyperconverged-operator.v0.0.1.clusterserviceversion.yaml:                        value: v0.17.0
./templates/olm-catalog/kubevirt-hyperconverged/VERSION/kubevirt-hyperconverged-operator.VERSION.clusterserviceversion.yaml.in:                        value: v0.17.0
./templates/operator.yaml.in:              value: v0.17.0
./hack/config:KUBEVIRT_VERSION="v0.17.0"
./hack/defaults:KUBEVIRT_MANIFEST_VERSION="v0.17.0"
Binary file ./.git/objects/pack/pack-4d034057f68f361ab777a0ac3ad3204ac6dac443.pack matches

[dhiller]

Trying again on kubevirtci:

$ export KUBEVIRT_PROVIDER=okd-4.1.0 OKD_CONSOLE_PORT=443
$ make cluster-up
...
$ export KUBECONFIG=$(cluster-up/kubeconfig.sh)
$ cluster-up/oc.sh get pods --all-namespaces                                                                                                                                                
NAMESPACE                                               NAME                                                              READY   STATUS      RESTARTS   AGE                                  
cluster-network-addons-operator                         cluster-network-addons-operator-599dc7f4c8-4zhbf                  1/1     Running     0          8d                                   
kubemacpool-system                                      kubemacpool-mac-controller-manager-644cb899cf-xv74s               1/1     Running     2          8d                                   
linux-bridge                                            bridge-marker-n7trm                                               1/1     Running     3          8d
linux-bridge                                            bridge-marker-wtkm6                                               1/1     Running     1          8d
linux-bridge                                            kube-cni-linux-bridge-plugin-g6bjv                                1/1     Running     1          8d
linux-bridge                                            kube-cni-linux-bridge-plugin-v5fqb                                1/1     Running     2          8d
openshift-apiserver-operator                            openshift-apiserver-operator-659785c78c-kbncm                     1/1     Running     0          8d
openshift-apiserver                                     apiserver-tmxxv                                                   1/1     Running     1          8d
openshift-authentication-operator                       authentication-operator-86bd89cb64-hcsps                          1/1     Running     0          8d
openshift-authentication                                oauth-openshift-668544577c-98xfs                                  1/1     Running     0          32m
openshift-authentication                                oauth-openshift-668544577c-9prj4                                  1/1     Running     0          31m
openshift-cloud-credential-operator                     cloud-credential-operator-6cff76c999-npfzq                        1/1     Running     0          8d
openshift-cluster-machine-approver                      machine-approver-7cd7f97455-gpnms                                 1/1     Running     0          31m
openshift-cluster-node-tuning-operator                  cluster-node-tuning-operator-795c9dfc96-sm4s7                     1/1     Running     0          8d
openshift-cluster-node-tuning-operator                  tuned-kc2gc                                                       1/1     Running     3          8d
openshift-cluster-node-tuning-operator                  tuned-tnp9l                                                       1/1     Running     1          8d
openshift-cluster-samples-operator                      cluster-samples-operator-67b8c675c4-9ztvx                         1/1     Running     0          8d
openshift-cluster-storage-operator                      cluster-storage-operator-754c849f5c-27bx8                         1/1     Running     0          8d
openshift-console-operator                              console-operator-646b694cfb-rhwcr                                 1/1     Running     0          8d
openshift-console                                       console-5dff78789b-mdnzj                                          1/1     Running     0          8d
openshift-console                                       console-5dff78789b-xkwb5                                          1/1     Running     0          8d
openshift-console                                       downloads-65877c7d-c55j9                                          1/1     Running     0          8d
openshift-console                                       downloads-65877c7d-dcd4r                                          1/1     Running     0          8d
openshift-controller-manager-operator                   openshift-controller-manager-operator-74855c96bd-p8t9w            1/1     Running     0          8d
openshift-controller-manager                            controller-manager-wwz7b                                          1/1     Running     1          8d
openshift-dns-operator                                  dns-operator-67cb8f9f94-fvxw5                                     1/1     Running     0          8d
openshift-dns                                           dns-default-hl57j                                                 2/2     Running     2          8d
openshift-dns                                           dns-default-lvvzh                                                 2/2     Running     4          8d
openshift-etcd                                          etcd-member-test-1-d8fcd-master-0                                 2/2     Running     2          8d
openshift-image-registry                                cluster-image-registry-operator-644dfbf98b-k229j                  1/1     Running     0          8d
openshift-image-registry                                image-registry-b58b955c-54jrg                                     1/1     Running     0          8d
openshift-image-registry                                node-ca-6dgqq                                                     1/1     Running     1          8d
openshift-image-registry                                node-ca-lskrl                                                     1/1     Running     2          8d
openshift-ingress-operator                              ingress-operator-c6d68c8cb-xhnjm                                  1/1     Running     0          8d
openshift-ingress                                       router-default-67c95f7445-bq7x2                                   0/1     Pending     0          8d
openshift-ingress                                       router-default-67c95f7445-nd4wl                                   1/1     Running     0          8d
openshift-kube-apiserver-operator                       kube-apiserver-operator-6bcfbb68d9-ms9nc                          1/1     Running     0          8d
openshift-kube-apiserver                                installer-6-test-1-d8fcd-master-0                                 0/1     Completed   0          32m
openshift-kube-apiserver                                kube-apiserver-test-1-d8fcd-master-0                              2/2     Running     2          8d
openshift-kube-apiserver                                revision-pruner-5-test-1-d8fcd-master-0                           0/1     Completed   0          32m
openshift-kube-apiserver                                revision-pruner-6-test-1-d8fcd-master-0                           0/1     Completed   0          31m
openshift-kube-controller-manager-operator              kube-controller-manager-operator-5565c768b6-xlzzp                 1/1     Running     0          8d
openshift-kube-controller-manager                       installer-5-test-1-d8fcd-master-0                                 0/1     Completed   0          32m
openshift-kube-controller-manager                       kube-controller-manager-test-1-d8fcd-master-0                     2/2     Running     2          8d
openshift-kube-controller-manager                       revision-pruner-4-test-1-d8fcd-master-0                           0/1     Completed   0          32m
openshift-kube-controller-manager                       revision-pruner-5-test-1-d8fcd-master-0                           0/1     Completed   0          31m
openshift-kube-scheduler-operator                       openshift-kube-scheduler-operator-7f4779f978-24l7r                1/1     Running     0          8d
openshift-kube-scheduler                                installer-6-test-1-d8fcd-master-0                                 0/1     Completed   0          31m
openshift-kube-scheduler                                openshift-kube-scheduler-test-1-d8fcd-master-0                    1/1     Running     1          8d
openshift-kube-scheduler                                revision-pruner-5-test-1-d8fcd-master-0                           0/1     Completed   0          31m
openshift-kube-scheduler                                revision-pruner-6-test-1-d8fcd-master-0                           0/1     Completed   0          31m
openshift-machine-api                                   cluster-autoscaler-operator-7988df7df4-prbv2                      1/1     Running     0          8d
openshift-machine-api                                   machine-api-controllers-6c8ddc4cc-vqx64                           4/4     Running     0          8d
openshift-machine-api                                   machine-api-operator-66f55c847-wss2s                              1/1     Running     0          8d
openshift-machine-config-operator                       etcd-quorum-guard-66b78568d6-64x77                                0/1     Pending     0          8d
openshift-machine-config-operator                       etcd-quorum-guard-66b78568d6-tjlrm                                1/1     Running     1          8d
openshift-machine-config-operator                       etcd-quorum-guard-66b78568d6-wzxmf                                0/1     Pending     0          8d
openshift-machine-config-operator                       machine-config-controller-69876f9fc5-4zdsp                        1/1     Running     0          8d
openshift-machine-config-operator                       machine-config-server-ktkxc                                       1/1     Running     1          8d
openshift-marketplace                                   certified-operators-9b6dcd85b-q5l9g                               1/1     Running     0          31m
openshift-marketplace                                   community-operators-7874cccccf-6tmdg                              1/1     Running     0          31m
openshift-marketplace                                   marketplace-operator-c568c789f-5cz9c                              1/1     Running     0          8d
openshift-marketplace                                   redhat-operators-754775f875-rfrkz                                 1/1     Running     0          31m
openshift-monitoring                                    alertmanager-main-0                                               3/3     Running     0          31m
openshift-monitoring                                    alertmanager-main-1                                               3/3     Running     0          31m
openshift-monitoring                                    alertmanager-main-2                                               3/3     Running     0          30m
openshift-monitoring                                    cluster-monitoring-operator-56d4684966-5w7r2                      1/1     Running     0          8d
openshift-monitoring                                    grafana-7cbddfd4f6-qk52v                                          2/2     Running     0          31m
openshift-monitoring                                    kube-state-metrics-76dbd866ff-rdzcc                               3/3     Running     0          8d
openshift-monitoring                                    node-exporter-jb8q7                                               2/2     Running     2          8d
openshift-monitoring                                    node-exporter-kb4st                                               2/2     Running     6          8d
openshift-monitoring                                    prometheus-adapter-f455cd7b6-2lncd                                1/1     Running     0          8d
openshift-monitoring                                    prometheus-adapter-f455cd7b6-ggqlp                                1/1     Running     0          8d
openshift-monitoring                                    prometheus-k8s-0                                                  6/6     Running     1          8d
openshift-monitoring                                    prometheus-k8s-1                                                  6/6     Running     1          8d
openshift-monitoring                                    prometheus-operator-7bfd67bf6c-btw8j                              1/1     Running     0          8d
openshift-monitoring                                    telemeter-client-779fb584d4-rksst                                 3/3     Running     0          8d
openshift-multus                                        multus-c7btw                                                      1/1     Running     1          8d
openshift-multus                                        multus-ts8zs                                                      1/1     Running     3          8d
openshift-network-operator                              network-operator-5dd57dd7bd-77j2v                                 1/1     Running     0          8d
openshift-operator-lifecycle-manager                    catalog-operator-6998c87fc5-t8v42                                 1/1     Running     0          8d
openshift-operator-lifecycle-manager                    olm-operator-6bc4bc64f8-ql9tb                                     1/1     Running     0          8d
openshift-operator-lifecycle-manager                    olm-operators-fcpw5                                               1/1     Running     0          19m
openshift-operator-lifecycle-manager                    packageserver-86d78bff68-slr4m                                    1/1     Running     0          31m
openshift-operator-lifecycle-manager                    packageserver-86d78bff68-z772h                                    1/1     Running     0          31m
openshift-sdn                                           ovs-gb2w4                                                         1/1     Running     1          8d
openshift-sdn                                           ovs-h55s2                                                         1/1     Running     3          8d
openshift-sdn                                           sdn-6svm9                                                         1/1     Running     3          8d
openshift-sdn                                           sdn-9x8nh                                                         1/1     Running     3          8d
openshift-sdn                                           sdn-controller-2t8kp                                              1/1     Running     5          8d
openshift-service-ca-operator                           service-ca-operator-987fc4cdd-c79hp                               1/1     Running     0          8d
openshift-service-ca                                    apiservice-cabundle-injector-5bf59477d7-p7zwb                     1/1     Running     0          8d
openshift-service-ca                                    configmap-cabundle-injector-6cfcd498d7-6wr28                      1/1     Running     0          8d
openshift-service-ca                                    service-serving-cert-signer-7789d64745-g2vcq                      1/1     Running     0          8d
openshift-service-catalog-apiserver-operator            openshift-service-catalog-apiserver-operator-5dbfcf7bc5-kkb22     1/1     Running     0          8d
openshift-service-catalog-controller-manager-operator   openshift-service-catalog-controller-manager-operator-5bf686ndb   1/1     Running     0          8d
$ curl https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/deploy.sh | bash                                                                            
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current                                                                                                               
                                 Dload  Upload   Total   Spent    Left  Speed                                                                                                                 
100  2063  100  2063    0     0   5714      0 --:--:-- --:--:-- --:--:--  5698                                                                                                                
+ kubectl create ns kubevirt-hyperconverged                                                                                                                                                   
namespace/kubevirt-hyperconverged created                                                                                                                                                     
++ kubectl config current-context                                                                                                                                                             
+ kubectl config set-context admin --namespace=kubevirt-hyperconverged                                                                                                                        
Context "admin" modified.                                                                                                                                                                     
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/hco.crd.yaml                                                      
customresourcedefinition.apiextensions.k8s.io/hyperconvergeds.hco.kubevirt.io created                                                                                                         
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/kubevirt.crd.yaml                                                 
customresourcedefinition.apiextensions.k8s.io/kubevirts.kubevirt.io created                                                                                                                   
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/cdi.crd.yaml                                                      
customresourcedefinition.apiextensions.k8s.io/cdis.cdi.kubevirt.io created                                                                                                           + kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/cna.crd.yaml
Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/cna.crd.yaml": customresourced
efinitions.apiextensions.k8s.io "networkaddonsconfigs.networkaddonsoperator.network.kubevirt.io" already exists
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/ssp.crd.yaml
customresourcedefinition.apiextensions.k8s.io/kubevirtcommontemplatesbundles.kubevirt.io created
customresourcedefinition.apiextensions.k8s.io/kubevirtnodelabellerbundles.kubevirt.io created
customresourcedefinition.apiextensions.k8s.io/kubevirttemplatevalidators.kubevirt.io created
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/kwebui.crd.yaml
customresourcedefinition.apiextensions.k8s.io/kwebuis.kubevirt.io created
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/nodemaintenance.crd.yaml
customresourcedefinition.apiextensions.k8s.io/nodemaintenances.kubevirt.io created
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/cluster_role.yaml
clusterrole.rbac.authorization.k8s.io/hyperconverged-cluster-operator created
clusterrole.rbac.authorization.k8s.io/kubevirt-operator created
clusterrole.rbac.authorization.k8s.io/cdi-operator-cluster created
clusterrole.rbac.authorization.k8s.io/kubevirt-ssp-operator created
clusterrole.rbac.authorization.k8s.io/node-maintenance-operator created
clusterrole.rbac.authorization.k8s.io/kubevirt-web-ui-operator created
Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/cluster_role.yaml": clusterroles.rb
ac.authorization.k8s.io "cluster-network-addons-operator" already exists
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/service_account.yaml
serviceaccount/hyperconverged-cluster-operator created
serviceaccount/cdi-operator created
serviceaccount/kubevirt-operator created
serviceaccount/cluster-network-addons-operator created
serviceaccount/kubevirt-ssp-operator created
serviceaccount/kubevirt-web-ui-operator created 
serviceaccount/node-maintenance-operator created
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/cluster_role_binding.yaml
clusterrolebinding.rbac.authorization.k8s.io/hyperconverged-cluster-operator created
clusterrolebinding.rbac.authorization.k8s.io/kubevirt-operator created
clusterrolebinding.rbac.authorization.k8s.io/cdi-operator created
clusterrolebinding.rbac.authorization.k8s.io/cdi-operator-admin created
clusterrolebinding.rbac.authorization.k8s.io/cluster-network-addons-operator-admin created
clusterrolebinding.rbac.authorization.k8s.io/kubevirt-ssp-operator created
clusterrolebinding.rbac.authorization.k8s.io/kubevirt-web-ui-operator created
clusterrolebinding.rbac.authorization.k8s.io/node-maintenance-operator created
Error from server (AlreadyExists): error when creating "https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/cluster_role_binding.yaml": cluster
rolebindings.rbac.authorization.k8s.io "cluster-network-addons-operator" already exists
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/operator.yaml
deployment.apps/hyperconverged-cluster-operator created
deployment.apps/virt-operator created
deployment.apps/cdi-operator created
deployment.apps/cluster-network-addons-operator created
deployment.apps/kubevirt-ssp-operator created
deployment.apps/node-maintenance-operator created
deployment.apps/kubevirt-web-ui-operator created
+ kubectl create -f https://raw.githubusercontent.com/kubevirt/hyperconverged-cluster-operator/master/deploy/converged/crds/hco.cr.yaml
hyperconverged.hco.kubevirt.io/hyperconverged-cluster created

[dhiller]

$ cluster-up/kubectl.sh get pods -n kubevirt-hyperconverged                                                                                                                                 
NAME                                               READY   STATUS    RESTARTS   AGE                                                                                                           
cdi-apiserver-8c7546446-fsf4f                      1/1     Running   0          7m54s                                                                                                         
cdi-deployment-859c7c6555-2v4zs                    1/1     Running   0          7m53s                                                                                                         
cdi-operator-6695fd4448-24gwl                      1/1     Running   0          9m20s                                                                                                         
cdi-uploadproxy-68885cd468-plf2v                   1/1     Running   0          7m54s                                                                                                         
cluster-network-addons-operator-9cc9c9bf8-sckw8    1/1     Running   0          9m20s                                                                                                         
hyperconverged-cluster-operator-69757bb9f5-gxdsd   1/1     Running   0          9m21s                                                                                                         
kubevirt-ssp-operator-d5b75b8b5-4qpmc              1/1     Running   0          9m20s
kubevirt-web-ui-operator-c57f7fb85-ds68f           1/1     Running   0          9m20s
node-maintenance-operator-645f757d5-vnhhr          1/1     Running   0          9m20s
virt-operator-667b6c845d-24lm6                     1/1     Running   0          9m21s
virt-operator-667b6c845d-clckb                     1/1     Running   0          9m20s

virt-operator log attached:
kubevirt-hyperconverged_virt-operator-667b6c845d-clckb.log