Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support merge write disposition for delta table format on fileystem destination #1453

Closed
jorritsandbrink opened this issue Jun 10, 2024 · 0 comments · Fixed by #1600
Closed

Support merge write disposition for delta table format on fileystem destination #1453

jorritsandbrink opened this issue Jun 10, 2024 · 0 comments · Fixed by #1600
Assignees
@jorritsandbrink
Labels
enhancement New feature or request

Comments

@jorritsandbrink
Copy link
Collaborator

Feature description

I would like to use the merge write disposition when using the delta table format on the fileystem destination.

Are you a dlt user?

Yes, I'm already a dlt user.

Use case

No response

Proposed solution

This can be implemented using delta-rs TableMerger API: https://delta-io.github.io/delta-rs/api/delta_table/delta_table_merger/

Related issues

#1129
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jorritsandbrink jorritsandbrink

Labels
enhancement New feature or request
Projects
dlt core library
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add basic upsert support for delta table format in filesystem destination dlt-hub/dlt
1 participant
@jorritsandbrink