Skip to content

feat: migrate DuckLake catalog from SQLite to PostgreSQL#12

Merged
DataLabTechTV merged 15 commits intomainfrom
dev
Nov 25, 2025
Merged

feat: migrate DuckLake catalog from SQLite to PostgreSQL#12
DataLabTechTV merged 15 commits intomainfrom
dev

Conversation

@DataLabTechTV
Copy link
Copy Markdown
Owner

@DataLabTechTV DataLabTechTV commented Oct 21, 2025

We're migrating from a local SQLite catalog to a PostgreSQL catalog that is globally accessible from any node (e.g., locally and from the data lab infra). As a part of this migration, we'll also devise a strategy to migrate an existing catalog from SQLite to PostgreSQL, documenting this as a blog post and in a video.

To Do

  • Update to the latest DuckDB, DuckLake, and dbt-duckdb, and test support for DuckLake.
  • Run ingestion using SQLite.
  • Find and setup tools for migration.
  • Migrate SQLite into PostgreSQL.
  • Test access to DuckLake with the new PostgreSQL catalog.

@DataLabTechTV DataLabTechTV marked this pull request as ready for review November 25, 2025 10:41
@DataLabTechTV DataLabTechTV merged commit c2a8aae into main Nov 25, 2025
DataLabTechTV added a commit that referenced this pull request Nov 28, 2025
feat: migrate DuckLake catalog from SQLite to PostgreSQL
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant