Skip to content

Ducklake Postgres connection failure #5311

@geoHeil

Description

@geoHeil

I cannot get sqlmesh to connect to a postgres catalog backed ducklake.

See for details: see slack https://tobiko-data.slack.com/archives/C044BRE5W4S/p1757265727522759?thread_ts=1756984769.004739&cid=C044BRE5W4S

Example:

gateways:
    connection:
      type: duckdb
      catalogs:
        ducklake_catalog:
          type: postgres
          #path: data/catalog.ducklake
          # Fails: no schema/database found minidemo
          path: "postgres:dbname=ducklake_catalog user=${CATALOG_DB_USER} password=${CATALOG_DB_PASSWORD} host=db.mycompany.com port=5433"
          #path: duckpond_secret_catalog
          data_path: "s3://my-duck-lake/dev/minidemo"
          read_only: true
      extensions:
        - ducklake
        - httpfs
        - postgres
        - sqlite
      secrets:
        duckpond_secret_catalog:
          type: postgres
          host: db.mycompany.com
          port: 5433
          database: duckpond_catalog
          user: "{{ env_var('CATALOG_DB_USER') }}"
          password: "{{ env_var('CATALOG_DB_PASSWORD') }}"

        duckpond_secret_storage:
          type: s3
          key_id: "{{ env_var('OBJECT_STORE_ROOT_USER') }}"
          secret: "{{ env_var('OBJECT_STORE_ROOT_PASSWORD') }}"
          endpoint: "objectstore.mycompany.com"
          url_style: "path"
          region: "{{ env_var('OBJECT_STORE_REGION') }}"
          use_ssl: true
          scope: "s3://my-duck-lake"
    state_connection:
      type: postgres
      host: db.mycompany.com
      port: 5433
      database: sqlmesh_state_dev
      user: "{{ env_var('STATE_DB_USER') }}"
      password: "{{ env_var('STATE_DB_PASSWORD') }}"

default_gateway: dev

model_defaults:
  dialect: duckdb
  start: 2025-09-02
  cron: '@daily'

linter:
  enabled: true
  rules:
    - ambiguousorinvalidcolumn
    - invalidselectstarexpansion

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions