Skip to content

OpenShift 4 Development Environment (CodeReady Containers based)

Notifications You must be signed in to change notification settings

adavarski/OpenShift4-CRC-development

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

66 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

OpenShift 4 Development Environment (CRC based):

  • Setup CodeReady Containers (CRC) on Laptop (ubuntu)
  • Setting up CodeReady Containers (CRC) on a Remote Server (ubuntu) and Remote Access to CRC (remote OpenShift 4 development environment) from Laptop
  • OpenShift 4 (CRC) Playground

1.Setup Local OpenShift 4.x Cluster with CodeReady Containers

CRC will host your applications. CodeReady Containers brings a minimal, preconfigured OpenShift 4.x cluster to your local Laptop/Workstattion without the need for a server-based infrastructure.

CodeReady Containers requires the following minimum hardware and operating system requirements.

  • 4 virtual CPUs (vCPUs)
  • 9 GB of memory
  • 35 GB of storage space

Pre: Install Ubuntu/Linux Mint 20.1 on your laptop (16G RAM recomeended; 9G requered for CRC)

Register RH account for Red Hat CodeReady Containers(CRC) download and get pull secrets file (Note that a valid OpenShift user pull secret is required during installation. The pull secret can be copied or downloaded from the Pull Secret section of the Install on Laptop: Red Hat CodeReady Containers page on cloud.redhat.com.)

### Install required software packages
$ echo "$USER ALL=(ALL) NOPASSWD:ALL"|sudo tee -a /etc/sudoers
$ sudo apt install qemu-kvm libvirt-daemon libvirt-daemon-system network-manager dnsmasq

Download CRC and pull-secret in OPENSIFT directory:

$ mkdir OPENSHIFT && cd OPENSHIFT/
$ wget https://mirror.openshift.com/pub/openshift-v4/clients/crc/1.25.0/crc-linux-amd64.tar.xz 
# Latest version (20.06.2021): wget https://mirror.openshift.com/pub/openshift-v4/clients/crc/1.28.0/crc-linux-amd64.tar.xz)
$ tar -xJf ./crc-linux-amd64.tar.xz
### Place the binaries in your $PATH using .bash_profile
$ echo "export PATH=/home/davar/OPENSHIFT/crc-linux-1.25.0-amd64:/home/davar/.crc/bin/oc:$PATH" >> ~/.bash_profile
$ source ~/.bash_profile 
### Place the binaries in your $PATH PATH using .bashrc
$ vim ~/.bashrc
export PATH="~/.crc/bin:$PATH"
eval $(crc oc-env)
$ source ~/.bashrc 

Setup CRC:

### Check memory
$ vmstat -s
     16283144 K total memory
      9942484 K used memory
     10742588 K active memory
$ crc config set memory 12288
$ crc config set consent-telemetry no
$ crc config set pull-secret-file ~/OPENSHIFT/pull-secret.txt
$ crc config view
- consent-telemetry                     : no
- memory                                : 12288
- pull-secret-file                      : /home/davar/OPENSHIFT/pull-secret.txt

### Deploy CodeReady Containers virtual machine
$ crc setup
$ crc start

#### Check CRC/Confirm installation:

$ host -R 3 api.crc.testing
api.crc.testing has address 192.168.130.11
$ virsh list
$ virsh net-list
$ ip a s
$ sudo iptables -n -L
$ crc status
$ crc version
$ crc config set kubeadmin-password kubeadmin (v1.28.0+)
$ ssh -i ~/.crc/machines/crc/id_ecdsa core@"$(crc ip)" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null  -- systemctl list-unit-files --state=failed --all


### Check inside CRC VM
$ ssh -i ~/.crc/machines/crc/id_ecdsa core@"$(crc ip)"
Red Hat Enterprise Linux CoreOS 47.83.202103292105-0
  Part of OpenShift 4.7, RHCOS is a Kubernetes native operating system
  managed by the Machine Config Operator (`clusteroperator/machine-config`).

WARNING: Direct SSH access to machines is not recommended; instead,
make configuration changes via `machineconfig` objects:
  https://docs.openshift.com/container-platform/4.7/architecture/architecture-rhcos.html

---
### Setup user:developer in this example (add-cluster-role-to-user cluster-admin) and delete kubeadmin user (OPTIONAL: security) 
[core@crc-pkjt4-master-0 ~]$ oc --kubeconfig /opt/kubeconfig  adm policy add-cluster-role-to-user cluster-admin developer
clusterrole.rbac.authorization.k8s.io/cluster-admin added: "developer"


[core@crc-xl2km-master-0 ~]$ KUBECONFIG=/opt/kubeconfig kubectl get nodes
[core@crc-xl2km-master-0 ~]$ KUBECONFIG=/opt/kubeconfig kubectl describe nodes


[core@crc-xl2km-master-0 ~]$ sudo su -
[root@crc-xl2km-master-0 kubernetes]# cat /etc/*rele*
NAME="Red Hat Enterprise Linux CoreOS"
VERSION="47.83.202103292105-0"
VERSION_ID="4.7"
OPENSHIFT_VERSION="4.7"
RHEL_VERSION="8.3"
PRETTY_NAME="Red Hat Enterprise Linux CoreOS 47.83.202103292105-0 (Ootpa)"
ID="rhcos"
ID_LIKE="rhel fedora"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:8::coreos"
HOME_URL="https://www.redhat.com/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_BUGZILLA_PRODUCT="OpenShift Container Platform"
REDHAT_BUGZILLA_PRODUCT_VERSION="4.7"
REDHAT_SUPPORT_PRODUCT="OpenShift Container Platform"
REDHAT_SUPPORT_PRODUCT_VERSION="4.7"
OSTREE_VERSION='47.83.202103292105-0'
Red Hat Enterprise Linux CoreOS release 4.7
Red Hat Enterprise Linux CoreOS release 4.7

systemctl list-units --state=failed --all
ps -ef
crictl images
crictl ps -a
ls /etc/kubernetes/
ls /etc/kubernetes/manifests/
cat /etc/kubernetes/kubeconfig 
ls /var/log/containers/
hostname
hostname -i
hostname -I
systemctl status kubelet
critcl images|grep h2o

Start working with CRC:

### To be able to access your cluster, first set up your environment by running (Run the commands printed in your terminal or add them to your ~/.bashrc or ~/.zshrc or ~/.bash_profile file, then source it.)

$ crc oc-env
export PATH="/home/davar/.crc/bin/oc:$PATH"
# Run this command to configure your shell:
# eval $(crc oc-env)
$ eval $(crc oc-env)
$ crc ip
192.168.130.11
$ crc console --credentials
To login as a regular user, run 'oc login -u developer -p developer https://api.crc.testing:6443'.
To login as an admin, run 'oc login -u kubeadmin -p yiT2o-XfTVU-fr8ET-ahd5f https://api.crc.testing:6443'

### Login as Admin using command printed out:
$ oc login -u kubeadmin -p yiT2o-XfTVU-fr8ET-ahd5f https://api.crc.testing:6443
The server uses a certificate signed by an unknown authority.
You can bypass the certificate check, but any data you send to the server could be intercepted by others.
Use insecure connections? (y/n): y

Login successful.

You have access to 61 projects, the list has been suppressed. You can list all projects with 'oc projects'

Using project "default".
Welcome! See 'oc help' to get started.

### Confirm cluster setup/Usefull commands

$ oc whoami
$ oc get nodes
$ oc config view
### To view cluster operators (oc get clusteroperators)
$ oc get co
$ oc status
$ oc get po --all-namespaces

davar@devops:~$ oc get po --all-namespaces
NAMESPACE                                          NAME                                                     READY   STATUS      RESTARTS        AGE
hostpath-provisioner                               csi-hostpathplugin-l9hs2                                 4/4     Running     0               17d
openshift-apiserver-operator                       openshift-apiserver-operator-658c74d94c-f8cww            1/1     Running     0               18d
openshift-apiserver                                apiserver-b49fd6557-xrf6v                                2/2     Running     0               17d
openshift-authentication-operator                  authentication-operator-656d987bdf-x6sv5                 1/1     Running     0               18d
openshift-authentication                           oauth-openshift-6c6bd8bf5-cwvpk                          1/1     Running     0               10m
openshift-cluster-machine-approver                 machine-approver-65849fbc47-2pj2f                        2/2     Running     0               18d
openshift-cluster-samples-operator                 cluster-samples-operator-5c8f484875-f27zr                2/2     Running     0               18d
openshift-cluster-version                          cluster-version-operator-78c75b9fd4-plwwc                1/1     Running     0               18d
openshift-config-operator                          openshift-config-operator-6fbc9fdf5d-5xwcq               1/1     Running     1 (11m ago)     18d
openshift-console-operator                         console-operator-77f6bb6456-xpd4w                        2/2     Running     0               18d
openshift-console                                  console-54cd797957-79t6v                                 1/1     Running     0               18d
openshift-console                                  downloads-787795d45b-kzwtn                               1/1     Running     2 (10m ago)     18d
openshift-controller-manager-operator              openshift-controller-manager-operator-79b77b4b5b-m7jj6   1/1     Running     0               18d
openshift-controller-manager                       controller-manager-9f56bfc6f-gnkqs                       1/1     Running     0               10m
openshift-dns-operator                             dns-operator-5588f8464-h5xw5                             2/2     Running     0               18d
openshift-dns                                      dns-default-46pqw                                        2/2     Running     0               18d
openshift-dns                                      node-resolver-gxjbh                                      1/1     Running     0               18d
openshift-etcd-operator                            etcd-operator-774dc898cd-hd8rx                           1/1     Running     0               18d
openshift-etcd                                     etcd-crc-vlf7c-master-0                                  4/4     Running     0               18d
openshift-image-registry                           cluster-image-registry-operator-7dd75c64c9-9q6lk         1/1     Running     0               18d
openshift-image-registry                           image-registry-57bb4cc97f-54nd7                          1/1     Running     0               10m
openshift-image-registry                           node-ca-fxjxr                                            1/1     Running     0               18d
openshift-ingress-canary                           ingress-canary-pc5rg                                     1/1     Running     0               18d
openshift-ingress-operator                         ingress-operator-6cc897f595-wfn9t                        2/2     Running     1 (9m14s ago)   18d
openshift-ingress                                  router-default-b478d9ffc-tpwk5                           1/1     Running     0               18d
openshift-kube-apiserver-operator                  kube-apiserver-operator-7c4d4f9f94-db7np                 1/1     Running     0               18d
openshift-kube-apiserver                           kube-apiserver-crc-vlf7c-master-0                        5/5     Running     0               17d
openshift-kube-controller-manager-operator         kube-controller-manager-operator-5cb576b576-6cvc6        1/1     Running     0               18d
openshift-kube-controller-manager                  kube-controller-manager-crc-vlf7c-master-0               4/4     Running     0               18d
openshift-kube-controller-manager                  revision-pruner-8-crc-vlf7c-master-0                     0/1     Completed   0               17d
openshift-kube-scheduler-operator                  openshift-kube-scheduler-operator-7d47cb8b84-24q8b       1/1     Running     0               18d
openshift-kube-scheduler                           openshift-kube-scheduler-crc-vlf7c-master-0              3/3     Running     0               18d
openshift-kube-scheduler                           revision-pruner-8-crc-vlf7c-master-0                     0/1     Completed   0               17d
openshift-kube-storage-version-migrator-operator   kube-storage-version-migrator-operator-c48f7f6bc-x65zt   1/1     Running     0               18d
openshift-kube-storage-version-migrator            migrator-d7c55c96c-k8m4x                                 1/1     Running     0               18d
openshift-machine-api                              control-plane-machine-set-operator-546bc75864-v2p8m      1/1     Running     0               18d
openshift-machine-api                              machine-api-controllers-66569585db-xmmnv                 7/7     Running     0               18d
openshift-machine-api                              machine-api-operator-54fbff9f69-qqmpz                    2/2     Running     0               18d
openshift-machine-config-operator                  machine-config-controller-66bbf8b5dc-jzdjh               2/2     Running     0               18d
openshift-machine-config-operator                  machine-config-daemon-5mhlb                              2/2     Running     0               18d
openshift-machine-config-operator                  machine-config-operator-569f5fbd55-6vb5h                 2/2     Running     0               18d
openshift-machine-config-operator                  machine-config-server-m6wq2                              1/1     Running     0               18d
openshift-marketplace                              certified-operators-2wqvv                                1/1     Running     0               18d
openshift-marketplace                              community-operators-2cp46                                1/1     Running     0               18d
openshift-marketplace                              marketplace-operator-6df48fb-85w42                       1/1     Running     0               18d
openshift-marketplace                              redhat-marketplace-7bszm                                 1/1     Running     0               18d
openshift-marketplace                              redhat-operators-lgrtj                                   1/1     Running     0               18d
openshift-multus                                   multus-additional-cni-plugins-fnsjv                      1/1     Running     0               18d
openshift-multus                                   multus-admission-controller-7ccff848f9-wsj9r             2/2     Running     0               17d
openshift-multus                                   multus-v78gf                                             1/1     Running     0               18d
openshift-multus                                   network-metrics-daemon-7mxnf                             2/2     Running     0               18d
openshift-network-diagnostics                      network-check-source-6674b68887-8vp9g                    1/1     Running     0               18d
openshift-network-diagnostics                      network-check-target-ps5k7                               1/1     Running     0               18d
openshift-network-node-identity                    network-node-identity-x9c4r                              2/2     Running     0               18d
openshift-network-operator                         network-operator-67cbc44959-tqnl5                        1/1     Running     0               18d
openshift-oauth-apiserver                          apiserver-668d868b56-b7sdj                               1/1     Running     0               18d
openshift-operator-lifecycle-manager               catalog-operator-5fc6c444c5-v47l8                        1/1     Running     0               18d
openshift-operator-lifecycle-manager               collect-profiles-28493835-xpb5p                          0/1     Completed   0               11m
openshift-operator-lifecycle-manager               collect-profiles-28493850-qsgvr                          0/1     Completed   0               43s
openshift-operator-lifecycle-manager               olm-operator-6f894987c6-fw8j5                            1/1     Running     0               18d
openshift-operator-lifecycle-manager               package-server-manager-64c6657c96-7jl68                  1/1     Running     0               18d
openshift-operator-lifecycle-manager               packageserver-64dc769f7-2n58l                            1/1     Running     0               18d
openshift-route-controller-manager                 route-controller-manager-6f7cff494f-h79w2                1/1     Running     0               10m
openshift-sdn                                      sdn-controller-gsg7t                                     2/2     Running     0               18d
openshift-sdn                                      sdn-tn5wd                                                2/2     Running     0               18d
openshift-service-ca-operator                      service-ca-operator-5dcb54f7c6-pxrc9                     1/1     Running     0               18d
openshift-service-ca                               service-ca-6994655bd7-w7xln                              1/1     Running     0               18d

$ oc get routes --all-namespaces
$ oc get all --all-namespaces


davar@devops:~$ oc get routes --all-namespaces
NAMESPACE                  NAME              HOST/PORT                                                 PATH   SERVICES          PORT    TERMINATION            WILDCARD
openshift-authentication   oauth-openshift   oauth-openshift.apps-crc.testing                                 oauth-openshift   6443    passthrough/Redirect   None
openshift-console          console           console-openshift-console.apps-crc.testing                       console           https   reencrypt/Redirect     None
openshift-console          downloads         downloads-openshift-console.apps-crc.testing                     downloads         http    edge/Redirect          None
openshift-image-registry   default-route     default-route-openshift-image-registry.apps-crc.testing          image-registry    <all>   reencrypt              None
openshift-ingress-canary   canary            canary-openshift-ingress-canary.apps-crc.testing                 ingress-canary    8080    edge/Redirect          None
davar@devops:~$ oc get all --all-namespaces
Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
NAMESPACE                                          NAME                                                         READY   STATUS      RESTARTS      AGE
hostpath-provisioner                               pod/csi-hostpathplugin-l9hs2                                 4/4     Running     0             17d
openshift-apiserver-operator                       pod/openshift-apiserver-operator-658c74d94c-f8cww            1/1     Running     0             18d
openshift-apiserver                                pod/apiserver-b49fd6557-xrf6v                                2/2     Running     0             17d
openshift-authentication-operator                  pod/authentication-operator-656d987bdf-x6sv5                 1/1     Running     0             18d
openshift-authentication                           pod/oauth-openshift-6c6bd8bf5-cwvpk                          1/1     Running     0             38m
openshift-cluster-machine-approver                 pod/machine-approver-65849fbc47-2pj2f                        2/2     Running     0             18d
openshift-cluster-samples-operator                 pod/cluster-samples-operator-5c8f484875-f27zr                2/2     Running     0             18d
openshift-cluster-version                          pod/cluster-version-operator-78c75b9fd4-plwwc                1/1     Running     0             18d
openshift-config-operator                          pod/openshift-config-operator-6fbc9fdf5d-5xwcq               1/1     Running     1 (38m ago)   18d
openshift-console-operator                         pod/console-operator-77f6bb6456-xpd4w                        2/2     Running     0             18d
openshift-console                                  pod/console-54cd797957-79t6v                                 1/1     Running     0             18d
openshift-console                                  pod/downloads-787795d45b-kzwtn                               1/1     Running     2 (38m ago)   18d
openshift-controller-manager-operator              pod/openshift-controller-manager-operator-79b77b4b5b-m7jj6   1/1     Running     0             18d
openshift-controller-manager                       pod/controller-manager-9f56bfc6f-gnkqs                       1/1     Running     0             38m
openshift-dns-operator                             pod/dns-operator-5588f8464-h5xw5                             2/2     Running     0             18d
openshift-dns                                      pod/dns-default-46pqw                                        2/2     Running     0             18d
openshift-dns                                      pod/node-resolver-gxjbh                                      1/1     Running     0             18d
openshift-etcd-operator                            pod/etcd-operator-774dc898cd-hd8rx                           1/1     Running     0             18d
openshift-etcd                                     pod/etcd-crc-vlf7c-master-0                                  4/4     Running     0             18d
openshift-image-registry                           pod/cluster-image-registry-operator-7dd75c64c9-9q6lk         1/1     Running     0             18d
openshift-image-registry                           pod/image-registry-57bb4cc97f-54nd7                          1/1     Running     0             38m
openshift-image-registry                           pod/node-ca-fxjxr                                            1/1     Running     0             18d
openshift-ingress-canary                           pod/ingress-canary-pc5rg                                     1/1     Running     0             18d
openshift-ingress-operator                         pod/ingress-operator-6cc897f595-wfn9t                        2/2     Running     1 (36m ago)   18d
openshift-ingress                                  pod/router-default-b478d9ffc-tpwk5                           1/1     Running     0             18d
openshift-kube-apiserver-operator                  pod/kube-apiserver-operator-7c4d4f9f94-db7np                 1/1     Running     0             18d
openshift-kube-apiserver                           pod/kube-apiserver-crc-vlf7c-master-0                        5/5     Running     0             17d
openshift-kube-controller-manager-operator         pod/kube-controller-manager-operator-5cb576b576-6cvc6        1/1     Running     0             18d
openshift-kube-controller-manager                  pod/kube-controller-manager-crc-vlf7c-master-0               4/4     Running     0             18d
openshift-kube-controller-manager                  pod/revision-pruner-8-crc-vlf7c-master-0                     0/1     Completed   0             17d
openshift-kube-scheduler-operator                  pod/openshift-kube-scheduler-operator-7d47cb8b84-24q8b       1/1     Running     0             18d
openshift-kube-scheduler                           pod/openshift-kube-scheduler-crc-vlf7c-master-0              3/3     Running     0             18d
openshift-kube-scheduler                           pod/revision-pruner-8-crc-vlf7c-master-0                     0/1     Completed   0             17d
openshift-kube-storage-version-migrator-operator   pod/kube-storage-version-migrator-operator-c48f7f6bc-x65zt   1/1     Running     0             18d
openshift-kube-storage-version-migrator            pod/migrator-d7c55c96c-k8m4x                                 1/1     Running     0             18d
openshift-machine-api                              pod/control-plane-machine-set-operator-546bc75864-v2p8m      1/1     Running     0             18d
openshift-machine-api                              pod/machine-api-controllers-66569585db-xmmnv                 7/7     Running     0             18d
openshift-machine-api                              pod/machine-api-operator-54fbff9f69-qqmpz                    2/2     Running     0             18d
openshift-machine-config-operator                  pod/machine-config-controller-66bbf8b5dc-jzdjh               2/2     Running     0             18d
openshift-machine-config-operator                  pod/machine-config-daemon-5mhlb                              2/2     Running     0             18d
openshift-machine-config-operator                  pod/machine-config-operator-569f5fbd55-6vb5h                 2/2     Running     0             18d
openshift-machine-config-operator                  pod/machine-config-server-m6wq2                              1/1     Running     0             18d
openshift-marketplace                              pod/certified-operators-2wqvv                                1/1     Running     0             18d
openshift-marketplace                              pod/community-operators-2cp46                                1/1     Running     0             18d
openshift-marketplace                              pod/marketplace-operator-6df48fb-85w42                       1/1     Running     0             18d
openshift-marketplace                              pod/redhat-marketplace-7bszm                                 1/1     Running     0             18d
openshift-marketplace                              pod/redhat-operators-lgrtj                                   1/1     Running     0             18d
openshift-multus                                   pod/multus-additional-cni-plugins-fnsjv                      1/1     Running     0             18d
openshift-multus                                   pod/multus-admission-controller-7ccff848f9-wsj9r             2/2     Running     0             17d
openshift-multus                                   pod/multus-v78gf                                             1/1     Running     0             18d
openshift-multus                                   pod/network-metrics-daemon-7mxnf                             2/2     Running     0             18d
openshift-network-diagnostics                      pod/network-check-source-6674b68887-8vp9g                    1/1     Running     0             18d
openshift-network-diagnostics                      pod/network-check-target-ps5k7                               1/1     Running     0             18d
openshift-network-node-identity                    pod/network-node-identity-x9c4r                              2/2     Running     0             18d
openshift-network-operator                         pod/network-operator-67cbc44959-tqnl5                        1/1     Running     0             18d
openshift-oauth-apiserver                          pod/apiserver-668d868b56-b7sdj                               1/1     Running     0             18d
openshift-operator-lifecycle-manager               pod/catalog-operator-5fc6c444c5-v47l8                        1/1     Running     0             18d
openshift-operator-lifecycle-manager               pod/collect-profiles-28493835-xpb5p                          0/1     Completed   0             39m
openshift-operator-lifecycle-manager               pod/collect-profiles-28493850-qsgvr                          0/1     Completed   0             28m
openshift-operator-lifecycle-manager               pod/collect-profiles-28493865-7t8sx                          0/1     Completed   0             13m
openshift-operator-lifecycle-manager               pod/olm-operator-6f894987c6-fw8j5                            1/1     Running     0             18d
openshift-operator-lifecycle-manager               pod/package-server-manager-64c6657c96-7jl68                  1/1     Running     0             18d
openshift-operator-lifecycle-manager               pod/packageserver-64dc769f7-2n58l                            1/1     Running     0             18d
openshift-route-controller-manager                 pod/route-controller-manager-6f7cff494f-h79w2                1/1     Running     0             38m
openshift-sdn                                      pod/sdn-controller-gsg7t                                     2/2     Running     0             18d
openshift-sdn                                      pod/sdn-tn5wd                                                2/2     Running     0             18d
openshift-service-ca-operator                      pod/service-ca-operator-5dcb54f7c6-pxrc9                     1/1     Running     0             18d
openshift-service-ca                               pod/service-ca-6994655bd7-w7xln                              1/1     Running     0             18d

NAMESPACE                                          NAME                                           TYPE           CLUSTER-IP     EXTERNAL-IP                            PORT(S)                      AGE
default                                            service/kubernetes                             ClusterIP      10.217.4.1     <none>                                 443/TCP                      18d
default                                            service/openshift                              ExternalName   <none>         kubernetes.default.svc.cluster.local   <none>                       18d
openshift-apiserver-operator                       service/metrics                                ClusterIP      10.217.4.117   <none>                                 443/TCP                      18d
openshift-apiserver                                service/api                                    ClusterIP      10.217.4.204   <none>                                 443/TCP                      18d
openshift-apiserver                                service/check-endpoints                        ClusterIP      10.217.4.41    <none>                                 17698/TCP                    18d
openshift-authentication-operator                  service/metrics                                ClusterIP      10.217.5.115   <none>                                 443/TCP                      18d
openshift-authentication                           service/oauth-openshift                        ClusterIP      10.217.5.252   <none>                                 443/TCP                      18d
openshift-cloud-credential-operator                service/cco-metrics                            ClusterIP      10.217.5.200   <none>                                 8443/TCP                     18d
openshift-cluster-machine-approver                 service/machine-approver                       ClusterIP      None           <none>                                 9192/TCP                     18d
openshift-cluster-samples-operator                 service/metrics                                ClusterIP      None           <none>                                 60000/TCP                    18d
openshift-cluster-version                          service/cluster-version-operator               ClusterIP      10.217.5.70    <none>                                 9099/TCP                     18d
openshift-config-operator                          service/metrics                                ClusterIP      10.217.5.20    <none>                                 443/TCP                      18d
openshift-console-operator                         service/metrics                                ClusterIP      10.217.5.10    <none>                                 443/TCP                      18d
openshift-console-operator                         service/webhook                                ClusterIP      10.217.5.162   <none>                                 9443/TCP                     18d
openshift-console                                  service/console                                ClusterIP      10.217.4.59    <none>                                 443/TCP                      18d
openshift-console                                  service/downloads                              ClusterIP      10.217.5.175   <none>                                 80/TCP                       18d
openshift-controller-manager-operator              service/metrics                                ClusterIP      10.217.4.206   <none>                                 443/TCP                      18d
openshift-controller-manager                       service/controller-manager                     ClusterIP      10.217.5.61    <none>                                 443/TCP                      18d
openshift-dns-operator                             service/metrics                                ClusterIP      10.217.4.166   <none>                                 9393/TCP                     18d
openshift-dns                                      service/dns-default                            ClusterIP      10.217.4.10    <none>                                 53/UDP,53/TCP,9154/TCP       18d
openshift-etcd-operator                            service/metrics                                ClusterIP      10.217.4.236   <none>                                 443/TCP                      18d
openshift-etcd                                     service/etcd                                   ClusterIP      10.217.4.210   <none>                                 2379/TCP,9979/TCP            18d
openshift-image-registry                           service/image-registry                         ClusterIP      10.217.5.7     <none>                                 5000/TCP                     18d
openshift-image-registry                           service/image-registry-operator                ClusterIP      None           <none>                                 60000/TCP                    18d
openshift-ingress-canary                           service/ingress-canary                         ClusterIP      10.217.4.149   <none>                                 8080/TCP,8888/TCP            18d
openshift-ingress-operator                         service/metrics                                ClusterIP      10.217.4.153   <none>                                 9393/TCP                     18d
openshift-ingress                                  service/router-internal-default                ClusterIP      10.217.5.247   <none>                                 80/TCP,443/TCP,1936/TCP      18d
openshift-kube-apiserver-operator                  service/metrics                                ClusterIP      10.217.4.66    <none>                                 443/TCP                      18d
openshift-kube-apiserver                           service/apiserver                              ClusterIP      10.217.5.172   <none>                                 443/TCP                      18d
openshift-kube-controller-manager-operator         service/metrics                                ClusterIP      10.217.5.23    <none>                                 443/TCP                      18d
openshift-kube-controller-manager                  service/kube-controller-manager                ClusterIP      10.217.4.192   <none>                                 443/TCP                      18d
openshift-kube-scheduler-operator                  service/metrics                                ClusterIP      10.217.5.77    <none>                                 443/TCP                      18d
openshift-kube-scheduler                           service/scheduler                              ClusterIP      10.217.5.4     <none>                                 443/TCP                      18d
openshift-kube-storage-version-migrator-operator   service/metrics                                ClusterIP      10.217.5.112   <none>                                 443/TCP                      18d
openshift-machine-api                              service/cluster-autoscaler-operator            ClusterIP      10.217.5.49    <none>                                 443/TCP,9192/TCP             18d
openshift-machine-api                              service/control-plane-machine-set-operator     ClusterIP      10.217.5.193   <none>                                 9443/TCP                     18d
openshift-machine-api                              service/machine-api-controllers                ClusterIP      10.217.4.95    <none>                                 8441/TCP,8442/TCP,8444/TCP   18d
openshift-machine-api                              service/machine-api-operator                   ClusterIP      10.217.4.219   <none>                                 8443/TCP                     18d
openshift-machine-api                              service/machine-api-operator-machine-webhook   ClusterIP      10.217.5.12    <none>                                 443/TCP                      18d
openshift-machine-api                              service/machine-api-operator-webhook           ClusterIP      10.217.4.142   <none>                                 443/TCP                      18d
openshift-machine-config-operator                  service/machine-config-controller              ClusterIP      10.217.4.209   <none>                                 9001/TCP                     18d
openshift-machine-config-operator                  service/machine-config-daemon                  ClusterIP      10.217.4.118   <none>                                 9001/TCP                     18d
openshift-machine-config-operator                  service/machine-config-operator                ClusterIP      10.217.5.78    <none>                                 9001/TCP                     18d
openshift-marketplace                              service/certified-operators                    ClusterIP      10.217.4.169   <none>                                 50051/TCP                    18d
openshift-marketplace                              service/community-operators                    ClusterIP      10.217.5.9     <none>                                 50051/TCP                    18d
openshift-marketplace                              service/marketplace-operator-metrics           ClusterIP      10.217.4.39    <none>                                 8383/TCP,8081/TCP            18d
openshift-marketplace                              service/redhat-marketplace                     ClusterIP      10.217.5.133   <none>                                 50051/TCP                    18d
openshift-marketplace                              service/redhat-operators                       ClusterIP      10.217.5.113   <none>                                 50051/TCP                    18d
openshift-monitoring                               service/cluster-monitoring-operator            ClusterIP      None           <none>                                 8443/TCP                     18d
openshift-multus                                   service/multus-admission-controller            ClusterIP      10.217.5.222   <none>                                 443/TCP,8443/TCP             18d
openshift-multus                                   service/network-metrics-service                ClusterIP      None           <none>                                 8443/TCP                     18d
openshift-network-diagnostics                      service/network-check-source                   ClusterIP      None           <none>                                 17698/TCP                    18d
openshift-network-diagnostics                      service/network-check-target                   ClusterIP      10.217.5.46    <none>                                 80/TCP                       18d
openshift-network-operator                         service/metrics                                ClusterIP      None           <none>                                 9104/TCP                     18d
openshift-oauth-apiserver                          service/api                                    ClusterIP      10.217.4.35    <none>                                 443/TCP                      18d
openshift-operator-lifecycle-manager               service/catalog-operator-metrics               ClusterIP      10.217.5.209   <none>                                 8443/TCP                     18d
openshift-operator-lifecycle-manager               service/olm-operator-metrics                   ClusterIP      10.217.4.99    <none>                                 8443/TCP                     18d
openshift-operator-lifecycle-manager               service/packageserver-service                  ClusterIP      10.217.5.109   <none>                                 5443/TCP                     38m
openshift-route-controller-manager                 service/route-controller-manager               ClusterIP      10.217.4.52    <none>                                 443/TCP                      18d
openshift-sdn                                      service/sdn                                    ClusterIP      None           <none>                                 9101/TCP                     18d
openshift-sdn                                      service/sdn-controller                         ClusterIP      None           <none>                                 9106/TCP                     18d
openshift-service-ca-operator                      service/metrics                                ClusterIP      10.217.5.139   <none>                                 443/TCP                      18d

NAMESPACE                           NAME                                           DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR                                                 AGE
hostpath-provisioner                daemonset.apps/csi-hostpathplugin              1         1         1       1            1           <none>                                                        17d
openshift-dns                       daemonset.apps/dns-default                     1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-dns                       daemonset.apps/node-resolver                   1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-image-registry            daemonset.apps/node-ca                         1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-ingress-canary            daemonset.apps/ingress-canary                  1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-machine-config-operator   daemonset.apps/machine-config-daemon           1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-machine-config-operator   daemonset.apps/machine-config-server           1         1         1       1            1           node-role.kubernetes.io/master=                               18d
openshift-multus                    daemonset.apps/multus                          1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-multus                    daemonset.apps/multus-additional-cni-plugins   1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-multus                    daemonset.apps/network-metrics-daemon          1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-network-diagnostics       daemonset.apps/network-check-target            1         1         1       1            1           beta.kubernetes.io/os=linux                                   18d
openshift-network-node-identity     daemonset.apps/network-node-identity           1         1         1       1            1           beta.kubernetes.io/os=linux,node-role.kubernetes.io/master=   18d
openshift-sdn                       daemonset.apps/sdn                             1         1         1       1            1           kubernetes.io/os=linux                                        18d
openshift-sdn                       daemonset.apps/sdn-controller                  1         1         1       1            1           node-role.kubernetes.io/master=                               18d

NAMESPACE                                          NAME                                                     READY   UP-TO-DATE   AVAILABLE   AGE
openshift-apiserver-operator                       deployment.apps/openshift-apiserver-operator             1/1     1            1           18d
openshift-apiserver                                deployment.apps/apiserver                                1/1     1            1           18d
openshift-authentication-operator                  deployment.apps/authentication-operator                  1/1     1            1           18d
openshift-authentication                           deployment.apps/oauth-openshift                          1/1     1            1           18d
openshift-cluster-machine-approver                 deployment.apps/machine-approver                         1/1     1            1           18d
openshift-cluster-samples-operator                 deployment.apps/cluster-samples-operator                 1/1     1            1           18d
openshift-cluster-version                          deployment.apps/cluster-version-operator                 1/1     1            1           18d
openshift-config-operator                          deployment.apps/openshift-config-operator                1/1     1            1           18d
openshift-console-operator                         deployment.apps/console-operator                         1/1     1            1           18d
openshift-console                                  deployment.apps/console                                  1/1     1            1           18d
openshift-console                                  deployment.apps/downloads                                1/1     1            1           18d
openshift-controller-manager-operator              deployment.apps/openshift-controller-manager-operator    1/1     1            1           18d
openshift-controller-manager                       deployment.apps/controller-manager                       1/1     1            1           18d
openshift-dns-operator                             deployment.apps/dns-operator                             1/1     1            1           18d
openshift-etcd-operator                            deployment.apps/etcd-operator                            1/1     1            1           18d
openshift-image-registry                           deployment.apps/cluster-image-registry-operator          1/1     1            1           18d
openshift-image-registry                           deployment.apps/image-registry                           1/1     1            1           18d
openshift-ingress-operator                         deployment.apps/ingress-operator                         1/1     1            1           18d
openshift-ingress                                  deployment.apps/router-default                           1/1     1            1           18d
openshift-kube-apiserver-operator                  deployment.apps/kube-apiserver-operator                  1/1     1            1           18d
openshift-kube-controller-manager-operator         deployment.apps/kube-controller-manager-operator         1/1     1            1           18d
openshift-kube-scheduler-operator                  deployment.apps/openshift-kube-scheduler-operator        1/1     1            1           18d
openshift-kube-storage-version-migrator-operator   deployment.apps/kube-storage-version-migrator-operator   1/1     1            1           18d
openshift-kube-storage-version-migrator            deployment.apps/migrator                                 1/1     1            1           18d
openshift-machine-api                              deployment.apps/control-plane-machine-set-operator       1/1     1            1           18d
openshift-machine-api                              deployment.apps/machine-api-controllers                  1/1     1            1           18d
openshift-machine-api                              deployment.apps/machine-api-operator                     1/1     1            1           18d
openshift-machine-config-operator                  deployment.apps/machine-config-controller                1/1     1            1           18d
openshift-machine-config-operator                  deployment.apps/machine-config-operator                  1/1     1            1           18d
openshift-marketplace                              deployment.apps/marketplace-operator                     1/1     1            1           18d
openshift-multus                                   deployment.apps/multus-admission-controller              1/1     1            1           18d
openshift-network-diagnostics                      deployment.apps/network-check-source                     1/1     1            1           18d
openshift-network-operator                         deployment.apps/network-operator                         1/1     1            1           18d
openshift-oauth-apiserver                          deployment.apps/apiserver                                1/1     1            1           18d
openshift-operator-lifecycle-manager               deployment.apps/catalog-operator                         1/1     1            1           18d
openshift-operator-lifecycle-manager               deployment.apps/olm-operator                             1/1     1            1           18d
openshift-operator-lifecycle-manager               deployment.apps/package-server-manager                   1/1     1            1           18d
openshift-operator-lifecycle-manager               deployment.apps/packageserver                            1/1     1            1           18d
openshift-route-controller-manager                 deployment.apps/route-controller-manager                 1/1     1            1           18d
openshift-service-ca-operator                      deployment.apps/service-ca-operator                      1/1     1            1           18d
openshift-service-ca                               deployment.apps/service-ca                               1/1     1            1           18d

NAMESPACE                                          NAME                                                               DESIRED   CURRENT   READY   AGE
openshift-apiserver-operator                       replicaset.apps/openshift-apiserver-operator-658c74d94c            1         1         1       18d
openshift-apiserver                                replicaset.apps/apiserver-65798f8f58                               0         0         0       18d
openshift-apiserver                                replicaset.apps/apiserver-6854847b74                               0         0         0       18d
openshift-apiserver                                replicaset.apps/apiserver-747d455bb4                               0         0         0       17d
openshift-apiserver                                replicaset.apps/apiserver-79d5bc7d85                               0         0         0       18d
openshift-apiserver                                replicaset.apps/apiserver-b49fd6557                                1         1         1       17d
openshift-authentication-operator                  replicaset.apps/authentication-operator-656d987bdf                 1         1         1       18d
openshift-authentication                           replicaset.apps/oauth-openshift-545f5b88fb                         0         0         0       18d
openshift-authentication                           replicaset.apps/oauth-openshift-6bbfd77496                         0         0         0       17d
openshift-authentication                           replicaset.apps/oauth-openshift-6bf9559c89                         0         0         0       18d
openshift-authentication                           replicaset.apps/oauth-openshift-6c6bd8bf5                          1         1         1       38m
openshift-authentication                           replicaset.apps/oauth-openshift-86f896cd97                         0         0         0       18d
openshift-authentication                           replicaset.apps/oauth-openshift-87b84d8d9                          0         0         0       17d
openshift-cluster-machine-approver                 replicaset.apps/machine-approver-65849fbc47                        1         1         1       18d
openshift-cluster-samples-operator                 replicaset.apps/cluster-samples-operator-5c8f484875                1         1         1       18d
openshift-cluster-version                          replicaset.apps/cluster-version-operator-6fcbf48457                0         0         0       18d
openshift-cluster-version                          replicaset.apps/cluster-version-operator-78c75b9fd4                1         1         1       18d
openshift-config-operator                          replicaset.apps/openshift-config-operator-6fbc9fdf5d               1         1         1       18d
openshift-console-operator                         replicaset.apps/console-operator-77f6bb6456                        1         1         1       18d
openshift-console                                  replicaset.apps/console-54cd797957                                 1         1         1       18d
openshift-console                                  replicaset.apps/console-76b47d46c6                                 0         0         0       18d
openshift-console                                  replicaset.apps/console-8b8b86558                                  0         0         0       18d
openshift-console                                  replicaset.apps/downloads-787795d45b                               1         1         1       18d
openshift-controller-manager-operator              replicaset.apps/openshift-controller-manager-operator-79b77b4b5b   1         1         1       18d
openshift-controller-manager                       replicaset.apps/controller-manager-555b7f6fb                       0         0         0       18d
openshift-controller-manager                       replicaset.apps/controller-manager-578c488f7                       0         0         0       18d
openshift-controller-manager                       replicaset.apps/controller-manager-64b54c6c77                      0         0         0       18d
openshift-controller-manager                       replicaset.apps/controller-manager-6c7775b96b                      0         0         0       17d
openshift-controller-manager                       replicaset.apps/controller-manager-6ccf4598c8                      0         0         0       18d
openshift-controller-manager                       replicaset.apps/controller-manager-6f44c55cf6                      0         0         0       17d
openshift-controller-manager                       replicaset.apps/controller-manager-7464fcb558                      0         0         0       18d
openshift-controller-manager                       replicaset.apps/controller-manager-786db8dccd                      0         0         0       38m
openshift-controller-manager                       replicaset.apps/controller-manager-78c5ff6478                      0         0         0       18d
openshift-controller-manager                       replicaset.apps/controller-manager-8586d4cd49                      0         0         0       17d
openshift-controller-manager                       replicaset.apps/controller-manager-9f56bfc6f                       1         1         1       38m
openshift-dns-operator                             replicaset.apps/dns-operator-5588f8464                             1         1         1       18d
openshift-etcd-operator                            replicaset.apps/etcd-operator-774dc898cd                           1         1         1       18d
openshift-image-registry                           replicaset.apps/cluster-image-registry-operator-7dd75c64c9         1         1         1       18d
openshift-image-registry                           replicaset.apps/image-registry-57bb4cc97f                          1         1         1       38m
openshift-image-registry                           replicaset.apps/image-registry-75fbc4cbd9                          0         0         0       17d
openshift-image-registry                           replicaset.apps/image-registry-b964bbc5d                           0         0         0       18d
openshift-image-registry                           replicaset.apps/image-registry-f6fc46597                           0         0         0       17d
openshift-ingress-operator                         replicaset.apps/ingress-operator-6cc897f595                        1         1         1       18d
openshift-ingress                                  replicaset.apps/router-default-b478d9ffc                           1         1         1       18d
openshift-kube-apiserver-operator                  replicaset.apps/kube-apiserver-operator-7c4d4f9f94                 1         1         1       18d
openshift-kube-controller-manager-operator         replicaset.apps/kube-controller-manager-operator-5cb576b576        1         1         1       18d
openshift-kube-scheduler-operator                  replicaset.apps/openshift-kube-scheduler-operator-7d47cb8b84       1         1         1       18d
openshift-kube-storage-version-migrator-operator   replicaset.apps/kube-storage-version-migrator-operator-c48f7f6bc   1         1         1       18d
openshift-kube-storage-version-migrator            replicaset.apps/migrator-d7c55c96c                                 1         1         1       18d
openshift-machine-api                              replicaset.apps/control-plane-machine-set-operator-546bc75864      1         1         1       18d
openshift-machine-api                              replicaset.apps/machine-api-controllers-66569585db                 1         1         1       18d
openshift-machine-api                              replicaset.apps/machine-api-operator-54fbff9f69                    1         1         1       18d
openshift-machine-config-operator                  replicaset.apps/machine-config-controller-66bbf8b5dc               1         1         1       18d
openshift-machine-config-operator                  replicaset.apps/machine-config-operator-569f5fbd55                 1         1         1       18d
openshift-marketplace                              replicaset.apps/marketplace-operator-6df48fb                       1         1         1       18d
openshift-multus                                   replicaset.apps/multus-admission-controller-5588fd57db             0         0         0       18d
openshift-multus                                   replicaset.apps/multus-admission-controller-6b469ff5c6             0         0         0       18d
openshift-multus                                   replicaset.apps/multus-admission-controller-7ccff848f9             1         1         1       17d
openshift-network-diagnostics                      replicaset.apps/network-check-source-6674b68887                    1         1         1       18d
openshift-network-operator                         replicaset.apps/network-operator-67cbc44959                        1         1         1       18d
openshift-oauth-apiserver                          replicaset.apps/apiserver-668d868b56                               1         1         1       18d
openshift-operator-lifecycle-manager               replicaset.apps/catalog-operator-5fc6c444c5                        1         1         1       18d
openshift-operator-lifecycle-manager               replicaset.apps/olm-operator-6f894987c6                            1         1         1       18d
openshift-operator-lifecycle-manager               replicaset.apps/package-server-manager-64c6657c96                  1         1         1       18d
openshift-operator-lifecycle-manager               replicaset.apps/packageserver-64dc769f7                            1         1         1       18d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-566c59f76b                0         0         0       18d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-579b75cdd5                0         0         0       18d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-5fd857d7f4                0         0         0       18d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-667b49d7fd                0         0         0       18d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-66988d4c68                0         0         0       38m
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-6f7cff494f                1         1         1       38m
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-75f69dc56                 0         0         0       18d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-7d8579d66f                0         0         0       18d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-86d5ddb684                0         0         0       17d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-9c78bb4c9                 0         0         0       17d
openshift-route-controller-manager                 replicaset.apps/route-controller-manager-ccd95d95                  0         0         0       17d
openshift-service-ca-operator                      replicaset.apps/service-ca-operator-5dcb54f7c6                     1         1         1       18d
openshift-service-ca                               replicaset.apps/service-ca-6994655bd7                              1         1         1       18d

NAMESPACE                              NAME                             SCHEDULE       SUSPEND   ACTIVE   LAST SCHEDULE   AGE
openshift-image-registry               cronjob.batch/image-pruner       0 0 * * *      False     0        <none>          18d
openshift-operator-lifecycle-manager   cronjob.batch/collect-profiles   */15 * * * *   False     0        13m             18d

NAMESPACE                              NAME                                  COMPLETIONS   DURATION   AGE
openshift-operator-lifecycle-manager   job.batch/collect-profiles-28493835   1/1           85s        39m
openshift-operator-lifecycle-manager   job.batch/collect-profiles-28493850   1/1           4s         28m
openshift-operator-lifecycle-manager   job.batch/collect-profiles-28493865   1/1           5s         13m

NAMESPACE   NAME                                                                                IMAGE REPOSITORY                                                                                                       TAGS                                                     UPDATED
openshift   imagestream.image.openshift.io/cli                                                  default-route-openshift-image-registry.apps-crc.testing/openshift/cli                                                  latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/cli-artifacts                                        default-route-openshift-image-registry.apps-crc.testing/openshift/cli-artifacts                                        latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/dotnet                                               default-route-openshift-image-registry.apps-crc.testing/openshift/dotnet                                               6.0,6.0-ubi8,7.0,7.0-ubi8,latest                         2 weeks ago
openshift   imagestream.image.openshift.io/dotnet-runtime                                       default-route-openshift-image-registry.apps-crc.testing/openshift/dotnet-runtime                                       6.0,6.0-ubi8,7.0,7.0-ubi8,latest                         2 weeks ago
openshift   imagestream.image.openshift.io/driver-toolkit                                       default-route-openshift-image-registry.apps-crc.testing/openshift/driver-toolkit                                       414.92.202402051952-0,latest                             2 weeks ago
openshift   imagestream.image.openshift.io/fuse7-eap-openshift                                  default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-eap-openshift                                  1.0,1.1,1.10,1.11,1.12,1.2,1.3,1.4,1.5 + 3 more...       2 weeks ago
openshift   imagestream.image.openshift.io/fuse7-eap-openshift-java11                           default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-eap-openshift-java11                           1.11,1.12                                                2 weeks ago
openshift   imagestream.image.openshift.io/fuse7-java-openshift                                 default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-java-openshift                                 1.0,1.1,1.10,1.11,1.12,1.2,1.3,1.4,1.5 + 3 more...       2 weeks ago
openshift   imagestream.image.openshift.io/fuse7-java11-openshift                               default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-java11-openshift                               1.11,1.12                                                2 weeks ago
openshift   imagestream.image.openshift.io/fuse7-karaf-openshift                                default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-karaf-openshift                                1.0,1.1,1.10,1.11,1.12,1.2,1.3,1.4,1.5 + 3 more...       2 weeks ago
openshift   imagestream.image.openshift.io/fuse7-karaf-openshift-jdk11                          default-route-openshift-image-registry.apps-crc.testing/openshift/fuse7-karaf-openshift-jdk11                          1.12                                                     2 weeks ago
openshift   imagestream.image.openshift.io/golang                                               default-route-openshift-image-registry.apps-crc.testing/openshift/golang                                               1.18-ubi7,1.18-ubi8,1.18-ubi9,latest                     2 weeks ago
openshift   imagestream.image.openshift.io/httpd                                                default-route-openshift-image-registry.apps-crc.testing/openshift/httpd                                                2.4,2.4-el7,2.4-el8,2.4-ubi8,2.4-ubi9 + 1 more...        2 weeks ago
openshift   imagestream.image.openshift.io/installer                                            default-route-openshift-image-registry.apps-crc.testing/openshift/installer                                            latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/installer-artifacts                                  default-route-openshift-image-registry.apps-crc.testing/openshift/installer-artifacts                                  latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/java                                                 default-route-openshift-image-registry.apps-crc.testing/openshift/java                                                 11,8,latest,openjdk-11-el7,openjdk-11-ubi8 + 3 more...   2 weeks ago
openshift   imagestream.image.openshift.io/java-runtime                                         default-route-openshift-image-registry.apps-crc.testing/openshift/java-runtime                                         latest,openjdk-11-ubi8,openjdk-17-ubi8 + 1 more...       2 weeks ago
openshift   imagestream.image.openshift.io/jboss-datagrid73-openshift                           default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-datagrid73-openshift                           1.0,1.1,1.2,1.3,1.4,1.5,1.6,1.7,1.8                      2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap-xp3-openjdk11-openshift                    default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap-xp3-openjdk11-openshift                    3.0,latest                                               2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap-xp3-openjdk11-runtime-openshift            default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap-xp3-openjdk11-runtime-openshift            3.0,latest                                               2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap-xp4-openjdk11-openshift                    default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap-xp4-openjdk11-openshift                    4.0,latest                                               2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap-xp4-openjdk11-runtime-openshift            default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap-xp4-openjdk11-runtime-openshift            4.0,latest                                               2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap74-openjdk11-openshift                      default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap74-openjdk11-openshift                      7.4.0,latest                                             2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap74-openjdk11-runtime-openshift              default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap74-openjdk11-runtime-openshift              7.4.0,latest                                             2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap74-openjdk8-openshift                       default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap74-openjdk8-openshift                       7.4.0,latest                                             2 weeks ago
openshift   imagestream.image.openshift.io/jboss-eap74-openjdk8-runtime-openshift               default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-eap74-openjdk8-runtime-openshift               7.4.0,latest                                             2 weeks ago
openshift   imagestream.image.openshift.io/jboss-webserver57-openjdk11-tomcat9-openshift-ubi8   default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-webserver57-openjdk11-tomcat9-openshift-ubi8   5.7.0,5.7.1,5.7.2,5.7.3,latest                           2 weeks ago
openshift   imagestream.image.openshift.io/jboss-webserver57-openjdk8-tomcat9-openshift-ubi8    default-route-openshift-image-registry.apps-crc.testing/openshift/jboss-webserver57-openjdk8-tomcat9-openshift-ubi8    5.7.0,5.7.1,5.7.2,5.7.3,latest                           2 weeks ago
openshift   imagestream.image.openshift.io/jenkins                                              default-route-openshift-image-registry.apps-crc.testing/openshift/jenkins                                              2,latest,ocp-upgrade-redeploy + 2 more...                2 weeks ago
openshift   imagestream.image.openshift.io/jenkins-agent-base                                   default-route-openshift-image-registry.apps-crc.testing/openshift/jenkins-agent-base                                   latest,scheduled-upgrade,user-maintained-upgrade         2 weeks ago
openshift   imagestream.image.openshift.io/mariadb                                              default-route-openshift-image-registry.apps-crc.testing/openshift/mariadb                                              10.3,10.3-el7,10.3-el8,10.5-el7 + 3 more...              2 weeks ago
openshift   imagestream.image.openshift.io/must-gather                                          default-route-openshift-image-registry.apps-crc.testing/openshift/must-gather                                          latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/mysql                                                default-route-openshift-image-registry.apps-crc.testing/openshift/mysql                                                8.0,8.0-el7,8.0-el8,8.0-el9,latest                       2 weeks ago
openshift   imagestream.image.openshift.io/network-tools                                        default-route-openshift-image-registry.apps-crc.testing/openshift/network-tools                                        latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/nginx                                                default-route-openshift-image-registry.apps-crc.testing/openshift/nginx                                                1.20-ubi7,1.20-ubi8,1.20-ubi9,latest                     2 weeks ago
openshift   imagestream.image.openshift.io/nodejs                                               default-route-openshift-image-registry.apps-crc.testing/openshift/nodejs                                               14-ubi7,16-ubi8,16-ubi8-minimal,16-ubi9 + 2 more...      2 weeks ago
openshift   imagestream.image.openshift.io/oauth-proxy                                          default-route-openshift-image-registry.apps-crc.testing/openshift/oauth-proxy                                          v4.4                                                     2 weeks ago
openshift   imagestream.image.openshift.io/openjdk-11-rhel7                                     default-route-openshift-image-registry.apps-crc.testing/openshift/openjdk-11-rhel7                                     1.0,1.1,1.10,1.11,1.12                                   2 weeks ago
openshift   imagestream.image.openshift.io/perl                                                 default-route-openshift-image-registry.apps-crc.testing/openshift/perl                                                 5.26-ubi8,5.30,5.30-el7,5.30-ubi8 + 3 more...            2 weeks ago
openshift   imagestream.image.openshift.io/php                                                  default-route-openshift-image-registry.apps-crc.testing/openshift/php                                                  7.3,7.3-ubi7,7.4-ubi8,8.0-ubi8,8.0-ubi9 + 1 more...      2 weeks ago
openshift   imagestream.image.openshift.io/postgresql                                           default-route-openshift-image-registry.apps-crc.testing/openshift/postgresql                                           10,10-el7,10-el8,12,12-el7,12-el8 + 6 more...            2 weeks ago
openshift   imagestream.image.openshift.io/postgresql13-for-sso75-openshift-rhel8               default-route-openshift-image-registry.apps-crc.testing/openshift/postgresql13-for-sso75-openshift-rhel8               13-el8                                                   2 weeks ago
openshift   imagestream.image.openshift.io/postgresql13-for-sso76-openshift-rhel8               default-route-openshift-image-registry.apps-crc.testing/openshift/postgresql13-for-sso76-openshift-rhel8               13-el8                                                   2 weeks ago
openshift   imagestream.image.openshift.io/python                                               default-route-openshift-image-registry.apps-crc.testing/openshift/python                                               2.7-ubi8,3.6-ubi8,3.8,3.8-ubi7,3.8-ubi8 + 3 more...      2 weeks ago
openshift   imagestream.image.openshift.io/redhat-openjdk18-openshift                           default-route-openshift-image-registry.apps-crc.testing/openshift/redhat-openjdk18-openshift                           1.10,1.11,1.12,1.3,1.4,1.5,1.6,1.7,1.8                   2 weeks ago
openshift   imagestream.image.openshift.io/redis                                                default-route-openshift-image-registry.apps-crc.testing/openshift/redis                                                6-el7,6-el8,6-el9,latest                                 2 weeks ago
openshift   imagestream.image.openshift.io/ruby                                                 default-route-openshift-image-registry.apps-crc.testing/openshift/ruby                                                 2.5-ubi8,2.7,2.7-ubi7,2.7-ubi8,3.0-ubi7 + 3 more...      2 weeks ago
openshift   imagestream.image.openshift.io/sso75-openshift-rhel8                                default-route-openshift-image-registry.apps-crc.testing/openshift/sso75-openshift-rhel8                                7.5,latest                                               2 weeks ago
openshift   imagestream.image.openshift.io/sso76-openshift-rhel8                                default-route-openshift-image-registry.apps-crc.testing/openshift/sso76-openshift-rhel8                                7.6,latest                                               2 weeks ago
openshift   imagestream.image.openshift.io/tests                                                default-route-openshift-image-registry.apps-crc.testing/openshift/tests                                                latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/tools                                                default-route-openshift-image-registry.apps-crc.testing/openshift/tools                                                latest                                                   2 weeks ago
openshift   imagestream.image.openshift.io/ubi8-openjdk-11                                      default-route-openshift-image-registry.apps-crc.testing/openshift/ubi8-openjdk-11                                      1.10,1.11,1.12,1.3                                       2 weeks ago
openshift   imagestream.image.openshift.io/ubi8-openjdk-11-runtime                              default-route-openshift-image-registry.apps-crc.testing/openshift/ubi8-openjdk-11-runtime                              1.10,1.11,1.12,1.9                                       2 weeks ago
openshift   imagestream.image.openshift.io/ubi8-openjdk-17                                      default-route-openshift-image-registry.apps-crc.testing/openshift/ubi8-openjdk-17                                      1.11,1.12                                                2 weeks ago
openshift   imagestream.image.openshift.io/ubi8-openjdk-17-runtime                              default-route-openshift-image-registry.apps-crc.testing/openshift/ubi8-openjdk-17-runtime                              1.11,1.12                                                2 weeks ago
openshift   imagestream.image.openshift.io/ubi8-openjdk-8                                       default-route-openshift-image-registry.apps-crc.testing/openshift/ubi8-openjdk-8                                       1.10,1.11,1.12,1.3                                       2 weeks ago
openshift   imagestream.image.openshift.io/ubi8-openjdk-8-runtime                               default-route-openshift-image-registry.apps-crc.testing/openshift/ubi8-openjdk-8-runtime                               1.10,1.11,1.12,1.9                                       2 weeks ago

NAMESPACE                  NAME                                       HOST/PORT                                                 PATH   SERVICES          PORT    TERMINATION            WILDCARD
openshift-authentication   route.route.openshift.io/oauth-openshift   oauth-openshift.apps-crc.testing                                 oauth-openshift   6443    passthrough/Redirect   None
openshift-console          route.route.openshift.io/console           console-openshift-console.apps-crc.testing                       console           https   reencrypt/Redirect     None
openshift-console          route.route.openshift.io/downloads         downloads-openshift-console.apps-crc.testing                     downloads         http    edge/Redirect          None
openshift-image-registry   route.route.openshift.io/default-route     default-route-openshift-image-registry.apps-crc.testing          image-registry    <all>   reencrypt              None
openshift-ingress-canary   route.route.openshift.io/canary            canary-openshift-ingress-canary.apps-crc.testing                 ingress-canary    8080    edge/Redirect          None
davar@devops:~$ 


### You can access the OpenShift cluster deployed locally from CLI or by opening the OpenShift 4.x console on your web browser.
$ oc login -u developer -p developer https://api.crc.testing:6443
### To open the console from your default web browser, run:
$ crc console
$ oc config use-context crc-admin


### To stop your OpenShift cluster, run the command:
$ crc stop
### If you want to delete an existing CodeReady Containers virtual machine, run:
$ crc delete
Do you want to delete the OpenShift cluster? [y/N]: y
Deleted the OpenShift cluster

$ crc cleanup
INFO Removing vsock configuration                 
INFO Removing 'crc' network from libvirt          
INFO Removing /etc/NetworkManager/dispatcher.d/99-crc.sh file 
INFO Using root access: Removing NetworkManager configuration file in /etc/NetworkManager/dispatcher.d/99-crc.sh 
INFO Using root access: Executing systemctl daemon-reload command 
INFO Using root access: Executing systemctl reload NetworkManager 
INFO Cleaning up AppArmor configuration           
INFO Using root access: Updating AppArmor configuration 
INFO Using root access: Changing permissions for /etc/apparmor.d/libvirt/TEMPLATE.qemu to 644  
INFO Removing the crc VM if exists                
INFO Removing pull secret from the keyring        
INFO Removing older logs                          
INFO Removing CRC Machine Instance directory      
INFO Removing hosts file records added by CRC     

### $ crc delete --clear-cache

2.Setting up CodeReady Containers on a remote server and remote access to CRC (remote OPENSHIFT environment)

Red Hat CodeReady Containers (CRC) is an amazing way of getting a minimal preconfigured OpenShift 4 up & running on your local machine with just two commands: crc setup & crc start. Done. But that simplicity comes at a price: RAM.

CRC minimum memory requirement is 9Gb, even with all the related monitoring, alerting, and telemetry functionality turned off by default. It is a fair price for such a powerful solution but most of us will struggle to run it together with our daily devops tools and enjoy a good user experience.

If you have the resources, a simple solution would be to run CRC on a different host. While it is in fact a pretty straightforward process, CRC itself runs as a VM so in order to access it remotely you will have to work around its network.

2.1.Setup On the remote host

### Install packages
$ echo "$USER ALL=(ALL) NOPASSWD:ALL"|sudo tee -a /etc/sudoers
$ sudo apt install qemu-kvm libvirt-daemon libvirt-daemon-system network-manager dnsmasq tinyproxy

### Setup tinyproxy
$ sudo systemctl start tinyproxy
$ sudo systemctl enable tinyproxy
$ diff /etc/tinyproxy/tinyproxy.conf /etc/tinyproxy/tinyproxy.conf.ORIG
224c224
< #Allow 127.0.0.1
---
> Allow 127.0.0.1
315d313
< ConnectPort 6443
$ sudo systemctl restart tinyproxy

### Note HAProxy
sudo apt install haproxy-y
sudo cp /etc/haproxy/haproxy.cfg{,.bak}

CRC_IP=$(crc ip)
sudo tee /etc/haproxy/haproxy.cfg &>/dev/null <<EOF
global
    log /dev/log local0

defaults
    balance roundrobin
    log global
    maxconn 100
    mode tcp
    timeout connect 5s
    timeout client 500s
    timeout server 500s

listen apps
    bind 0.0.0.0:80
    server crcvm $CRC_IP:80 check

listen apps_ssl
    bind 0.0.0.0:443
    server crcvm $CRC_IP:443 check

listen api
    bind 0.0.0.0:6443
    server crcvm $CRC_IP:6443 check
EOF

sudo systemctl enable haproxy --now
sudo systemctl restart haproxy




### Download CRC and pull-secret in OPENSIFT directory:
$ mkdir OPENSHIFT && cd OPENSHIFT/
$ wget https://mirror.openshift.com/pub/openshift-v4/clients/crc/1.25.0/crc-linux-amd64.tar.xz
$ tar -xJf ./crc-linux-amd64.tar.xz

### Place the binaries in your $PATH using .bash_profile
$ echo "export PATH=/home/davar/OPENSHIFT/crc-linux-1.25.0-amd64:/home/davar/.crc/bin/oc:$PATH" >> ~/.bash_profile
$ source ~/.bash_profile (or relogin)
### Place the binaries in your $PATH PATH using .bashrc
$ vim ~/.bashrc
export PATH="~/.crc/bin:$PATH"
eval $(crc oc-env)
$ source ~/.bashrc 

### Setup CRC:
$ crc config set memory 12288
$ crc config set consent-telemetry no
$ crc config set pull-secret-file ~/OPENSHIFT/pull-secret.txt
Successfully configured pull-secret-file to /home/davar/OPENSHIFT/pull-secret.txt
- consent-telemetry                     : no
- memory                                : 12288
- pull-secret-file                      : /home/davar/OPENSHIFT/pull-secret.txt

### Deploy CodeReady Containers virtual machine
$ crc setup
$ crc start

### Check CRC version and credentials
$ crc version
CodeReady Containers version: 1.25.0+0e5748c8
OpenShift version: 4.7.5 (embedded in executable)
$ crc console --credentials
To login as a regular user, run 'oc login -u developer -p developer https://api.crc.testing:6443'.
To login as an admin, run 'oc login -u kubeadmin -p yiT2o-XfTVU-fr8ET-ahd5f https://api.crc.testing:6443'

### Check if CodeReady Containers work
$ oc login -u kubeadmin -p yiT2o-XfTVU-fr8ET-ahd5f https://api.crc.testing:6443
$ oc get nodes

2.2.Setup On the Laptop

### Install oc client
$ wget https://mirror.openshift.com/pub/openshift-v4/clients/ocp/4.7.5/openshift-client-linux.tar.gz
$ tar -xvf openshift-client-linux.tar.gz 
$ sudo cp oc /usr/local/bin
$ sudo cp kubectl /usr/local/bin
$ oc version

### Configure /etc/hosts file (edit/add this lines):
127.0.0.1 localhost console-openshift-console.apps-crc.testing oauth-openshift.apps-crc.testing
### DevOps CRC remote server
192.168.1.99 devops

### SSH keys setup
$ ssh-copy-id -o IdentitiesOnly=yes -i ~/.ssh/id_rsa.pub davar@devops
$ ssh davar@devops

Example1: TERMINAL: Setup SSH tunneling to access OpenShift console from terminal (oc client to work)

### SSH tunnel in a new terminal
$ sudo ssh davar@devops -L 443:console-openshift-console.apps-crc.testing:443 
### In a new terminal
$ export https_proxy=http://devops:8888
### test api endpoint
$ curl -k https://api.crc.testing:6443
{
  "kind": "Status",
  "apiVersion": "v1",
  "metadata": {
    
  },
  "status": "Failure",
  "message": "forbidden: User \"system:anonymous\" cannot get path \"/\"",
  "reason": "Forbidden",
  "details": {
    
  },
  "code": 403
}
### Now you can login using oc client tool
$ oc login -u kubeadmin -p yiT2o-XfTVU-fr8ET-ahd5f https://api.crc.testing:6443
Login successful.

You have access to 62 projects, the list has been suppressed. You can list all projects with 'oc projects'

Using project "default".
$ oc get route
NAME    HOST/PORT                        PATH   SERVICES   PORT       TERMINATION   WILDCARD
nginx   nginx-default.apps-crc.testing          nginx      8080-tcp                 None

Example2 : BROWSER & TERMINAL: Setup SSH tunneling to access OpenShift console from browser and oc client to work

### SSH tunnel in a new terminal
$ sudo ssh davar@devops -L 7777:127.0.0.1:8888 -N

Access the Openshift Console

The Openshift Console UI is available at https://127.0.0.1:7777

Set proxy for http as well as ssl in your browser to point to: 127.0.0.1:7777

Firefox example below:

### TERMINAL: Setup for oc client to work
# In a new terminal
$ export https_proxy=http://127.0.0.1:7777
# test api endpoint

### Now you can login using oc client tool
$ oc login -u kubeadmin -p yiT2o-XfTVU-fr8ET-ahd5f https://api.crc.testing:6443
Login successful.

You have access to 62 projects, the list has been suppressed. You can list all projects with 'oc projects'

Using project "default".
$ oc get route
NAME    HOST/PORT                        PATH   SERVICES   PORT       TERMINATION   WILDCARD
nginx   nginx-default.apps-crc.testing          nginx      8080-tcp                 None

Example3: BROWSER: Setup SSH tunneling to access routes

### Configure /etc/hosts file : add nginx-default.apps-crc.testing
127.0.0.1	localhost console-openshift-console.apps-crc.testing oauth-openshift.apps-crc.testing nginx-default.apps-crc.testing

### SSH tunnel in a new terminal
$ sudo ssh davar@devops -L 7777:nginx-default.apps-crc.testing:80 -N

### test route api endpoint
$ curl -k http://nginx-default.apps-crc.testing:7777

### BROWSER -> http://nginx-default.apps-crc.testing:7777/
Welcome to nginx!
If you see this page, the nginx web server is successfully installed and working. Further configuration is required.

For online documentation and support please refer to nginx.org.
Commercial support is available at nginx.com.

Thank you for using nginx.


Ref: OpenShift Cheatsheet

About

OpenShift 4 Development Environment (CodeReady Containers based)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages