Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source MySQL or MSSQL: Possibility to exclude columns from synchronisation #4400

Closed
mcfuhrt opened this issue Jun 29, 2021 · 4 comments
Closed
Labels

Comments

@mcfuhrt
Copy link

mcfuhrt commented Jun 29, 2021

Tell us about the problem you're trying to solve

If you do not want to synchronise all columns of a table because they are either irrelevant or redundant, it would be helpful to exclude these columns from synchronisation. There may also be the case that the column contains too many characters and cannot be written to the target (e.g. coded images with 29k characters). This feature is implemented in Fivetran and in my opinion very use- and helpful.

Describe the solution you’d like

The columns to be synchronised should also be selectable when selecting the tables in the schema.

Describe the alternative you’ve considered or used

I cannot synchronise the required table and have to do without it

Additional context

Bildschirmfoto 2021-06-29 um 14 50 38
Bildschirmfoto 2021-06-29 um 14 43 24

Are you willing to submit a PR?

I'm willing, but I don't know where to start and have a look at.

@sotte
Copy link

sotte commented Oct 1, 2021

Super important feature required to be GDPR compliant. I must not sync certain columns.

Is there anything we can do to move this ticket further along?

@grishick
Copy link
Contributor

grishick commented Jul 1, 2022

I am adding this to Source MySQL to Beta epic for visibility. However, we are unlikely to fix this for MySQL beta or GA, because the blocking issue is not going to be ready by then.

@grishick grishick added the team/db-dw-sources Backlog for Database and Data Warehouse Sources team label Sep 27, 2022
@bleonard
Copy link
Contributor

@sotte you can make a view and sync that. We are adding column selection to the platform and will solve this ticket as part of that.

@bleonard
Copy link
Contributor

Closing as duplicate of #9771

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

6 participants