Empty-Configmap for Trino-Coordinator catalog (hive.properties)

The config-map for the trino catalog is not loading correctly for the trino-coordinator.
Here it is expected that the properties are loaded, in this case the hive.properties with the s3-connection.
I know that there are already innovations in development. Should we wait for it?

What have we done:
We install the most current stable stackabletech operators on k8s version 0.22.6.

Operators:

• trino-operator (0.2.0)
• hive-operator (0.6.0)
• opa-operator (0.7.0)
• regorule-operator (0.6.0)

Trino configuration:

apiVersion: trino.stackable.tech/v1alpha1
kind: TrinoCluster
metadata:
  name: trino-cluster
  namespace: bi-stack
spec:
  version: "0.0.362"
  nodeEnvironment: qa
  hiveReference:
    namespace: bi-stack
    name: hive-derby
  opa:
    name: opa
    namespace: bi-stack
  authorization:
    package: trino
    permissions:
      admin:
        schemas:
          read: true
          write: true
  s3Connection:
    endPoint: "https://s3-de-central.profitbricks.com"
    accessKey: "***"
    secretKey: "***"
    sslEnabled: true
    pathStyleAccess: true
  coordinators:
    roleGroups:
      default:
        selector:
          matchLabels:
            kubernetes.io/os: linux
        replicas: 1 
        config:
          coordinator: true
          nodeDataDir: /stackable/trino/data
          metricsPort: 10200
          httpServerHttpPort: 8083
          httpServerHttpsPort: 8445
          passwordFileContent: |
            ...
          serverCertificate: |
            ...
  workers:
    roleGroups:
      default:
        selector:
          matchLabels:
            kubernetes.io/os: linux
        replicas: 1
        config:
          nodeDataDir: /stackable/trino/data
          metricsPort: 10201
          httpServerHttpPort: 8085

What we get:

apiVersion: v1
kind: ConfigMap
metadata:
  name: trino-trinocluster-coordinator-default-hive-wl7jz
  generateName: trino-trinocluster-coordinator-default-hive-
  namespace: bi-stack
  labels:
    app.kubernetes.io/component: coordinator
    app.kubernetes.io/instance: trino-cluster
    app.kubernetes.io/managed-by: trino-operator
    app.kubernetes.io/name: trino
    app.kubernetes.io/role-group: default
    app.kubernetes.io/version: 0.0.362
    configmap.stackable.tech/hash: '6045911192929794608'
    configmap.stackable.tech/type: hive
  ownerReferences:
    - apiVersion: trino.stackable.tech/v1alpha1
      kind: TrinoCluster
      name: trino-cluster
      uid: 6a2e635d-2106-401e-b26e-07cab41bf125
      controller: true
      blockOwnerDeletion: true
  selfLink: >-
    /api/v1/namespaces/bi-stack/configmaps/trino-trinocluster-coordinator-default-hive-wl7jz
data: {}

What we want:

apiVersion: v1
kind: ConfigMap
metadata:
  name: trino-trinocluster-coordinator-default-hive-wl7jz
  generateName: trino-trinocluster-coordinator-default-hive-
  namespace: bi-stack
  labels:
    app.kubernetes.io/component: coordinator
    app.kubernetes.io/instance: trino-cluster
    app.kubernetes.io/managed-by: trino-operator
    app.kubernetes.io/name: trino
    app.kubernetes.io/role-group: default
    app.kubernetes.io/version: 0.0.362
    configmap.stackable.tech/hash: '6045911192929794608'
    configmap.stackable.tech/type: hive
  ownerReferences:
    - apiVersion: trino.stackable.tech/v1alpha1
      kind: TrinoCluster
      name: trino-cluster
      uid: 6a2e635d-2106-401e-b26e-07cab41bf125
      controller: true
      blockOwnerDeletion: true
  selfLink: >-
    /api/v1/namespaces/bi-stack/configmaps/trino-trinocluster-coordinator-default-hive-wl7jz
data:  
  hive.properties: |
    connector.name=hive
    hive.metastore.uri=thrift://trino-derby:9083
    hive.s3.aws-access-key=
    hive.s3.aws-secret-key=
    hive.s3.endpoint=
    hive.s3.ssl.enabled=false

The trino operator returns the following error message:

2022-02-10T13:38:56.064121Z  INFO stackable_operator::utils: Starting Stackable Operator for Trino
2022-02-10T13:38:56.064149Z  INFO stackable_operator::utils: This is version 0.2.0, built for x86_64-unknown-linux-gnu by rustc 1.57.0 (f1edd0429 2021-11-29) at Mon, 06 Dec 2021 15:11:41 +0000
2022-02-10T13:38:56.545123Z ERROR stackable_operator::controller: Reconciliation finished with an error, this should not happen, please file an issue err=QueueError { source: WatchError { source: ErrorResponse { status: "Failure", message: "too old resource version: 288180108 (288180109)", reason: "Expired", code: 410 }, backtrace: Backtrace(()) }, backtrace: Backtrace(()) }
2022-02-10T13:38:56.629406Z ERROR stackable_operator::controller: Reconciliation finished with an error, this should not happen, please file an issue err=QueueError { source: WatchError { source: ErrorResponse { status: "Failure", message: "too old resource version: 288180096 (288180115)", reason: "Expired", code: 410 }, backtrace: Backtrace(()) }, backtrace: Backtrace(()) }
2022-02-10T13:39:14.191725Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=object updated}:reconcile{request_id=abc32732-26d7-4769-a364-03c601c6e8cd}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:14.248730Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=object updated}:reconcile{request_id=abc32732-26d7-4769-a364-03c601c6e8cd}: stackable_operator::versioning: Initial installation of version [0.0.362]
2022-02-10T13:39:14.640379Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=object updated}:reconcile{request_id=51fec407-0cf7-4a5f-a653-d236c7f7f732}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:15.501961Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=object updated}:reconcile{request_id=368cbdd8-37c6-4096-8a02-456f4e8436c5}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:15.698469Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=related object updated: Pod.v1./trino-trinocluster-coordinator-default-stackablebistackpo-2ssn7.bi-stack}:reconcile{request_id=be3d88a2-8d5c-4ab7-b5f0-43f9768475ba}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:16.565545Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=reconciler requested retry}:reconcile{request_id=48ee244e-98fd-42cc-aab7-ef666de5256b}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:17.284869Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=related object updated: ConfigMap.v1./trino-trinocluster-worker-default-config-sbg5m.bi-stack}:reconcile{request_id=7fca86cf-71ee-4ec2-b5bd-15e37cfdd51a}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:17.503507Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=related object updated: Pod.v1./trino-trinocluster-worker-default-stackablebistackpocpool-2fdmz.bi-stack}:reconcile{request_id=9890b8e1-1e67-4815-a106-3173fd3cb93a}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:18.604175Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=reconciler requested retry}:reconcile{request_id=37029b01-db9d-4d28-b027-bb86196e5255}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:19.160196Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=object updated}:reconcile{request_id=fc7355c6-a4cb-41f5-a851-a22d3e615915}: stackable_trino_operator: ========================= Starting reconciliation =========================
2022-02-10T13:39:19.589727Z  INFO reconciling object{object.ref=TrinoCluster.v1alpha1.trino.stackable.tech/trino-cluster.bi-stack object.reason=object updated}:reconcile{request_id=78d87c74-5851-40f6-aa54-3f1ea567befe}: stackable_trino_operator: ========================= Starting reconciliation =========================

[maltesander]

Trino 0.2.0 is very outdated. Can you try the 0.3.0-nightly?
We are currently adapting the discovery mechanism to be consistent over all operators (#131).
This will result in only setting up the config map name of OPA / Hive.

For the error now. Can you check that the s3 or s3Connection are the same in the example and the crd? There was a name change.

Since updating the trino operator in the stable repository from 0.2.0 to 0.3.0, I have a permission error.

[maltesander]

We will provide a patch release tomorrow to address that. Its a permission problem that does not happen in kind, but in most managed clusters.

[maltesander]

Trino 0.3.1 released with a fix for the permission denied error.
https://repo.stackable.tech/#browse/browse:helm-stable:trino-operator%2F0.3.1%2Ftrino-operator-0.3.1.tgz

The error is no longer displayed. Thank you :)

Hmm, unfortunately the config map is still empty :/
--> trino-cluster-coordinator-default-catalog
Maybe I still have to wait for the devel version (0.3.2).
My config with (0.3.1):

apiVersion: trino.stackable.tech/v1alpha1
kind: TrinoCluster
metadata:
  namespace: bi-stack
  name: trino-cluster
spec:
  version: "0.0.362"
  nodeEnvironment: production
  authentication:
    method:
      multiUser:
        userCredentialsSecret:
          namespace: default
          name: trino-secrets
  authorization:
    package: trino
    permissions:
      admin:
        schemas:
          read: true
          write: true
  s3:
    endPoint: "https://s3-de-central.profitbricks.com"
    accessKey: "***"
    secretKey: "***"
    sslEnabled: true
    pathStyleAccess: true
  coordinators:
    roleGroups:
      default:
        selector:
          matchLabels:
            kubernetes.io/os: linux
        replicas: 1
        config: {}
  workers:
    roleGroups:
      default:
        selector:
          matchLabels:
            kubernetes.io/os: linux
        replicas: 1

[maltesander]

Have a look at this. You need to specify a hive reference for that.

I removed the hiveReference / hive because the custom resource threw a syntax error. I had assumed here that it is no longer needed (it will be found automatically in the custom resources or something).

[maltesander]

Yeah we changed the discovery mechanism. Does it work now?

Ok it works, thanks :)