Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Postgresql to Clickhouse #597

Open
meysammeisam opened this issue May 16, 2024 · 1 comment
Open

Postgresql to Clickhouse #597

meysammeisam opened this issue May 16, 2024 · 1 comment
Labels
enhancement New feature or request postgres Issues related to PostgreSQL

Comments

@meysammeisam
Copy link

meysammeisam commented May 16, 2024

This project supports toolsets to Dump Mysql data and then restore it to Clickhouse.
We are using it for our Mysql replications, but I'm wondering what would be the solution for the Postgresql DBs.
Does anyone know any workaround or toolset to cover that?
So the idea is to:

  • Start the Sink Connector Light in schema-only mode to incrementally replicate the data from the source DB to CH
  • Dump the rest of the data and restore it to Clickhouse manually

As mentioned before, we do the same with Mysql DBs and now looking for a similar solution for our Postgres DBs.

@aadant
Copy link
Collaborator

aadant commented May 16, 2024

@meysammeisam indeed, it is a cool feature. We would also need to implement the checksum for Postgres and the fast table counts.

This project is open source, feel free to contribute !

@subkanthi subkanthi added enhancement New feature or request postgres Issues related to PostgreSQL labels May 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request postgres Issues related to PostgreSQL
Projects
None yet
Development

No branches or pull requests

3 participants