Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decouple table creation and data loading #139

Closed
nj1973 opened this issue Mar 28, 2024 · 0 comments · Fixed by #149
Closed

Decouple table creation and data loading #139

nj1973 opened this issue Mar 28, 2024 · 0 comments · Fixed by #149
Assignees
Labels
enhancement New feature or request p1 High priority

Comments

@nj1973
Copy link
Collaborator

nj1973 commented Mar 28, 2024

Current behaviour prevents the user from first time offload of data to an existing table. We can append to a partitioned table but not a non-partitioned one.

We should support offloading to a table if it is empty without need for extra options.

If the table is empty and has no metadata then we can just allow the Offload to continue, after first validating column names and supported data type combinations. If metadata exists then something is amiss and we should supporting --reuse-backend-table as a variation on --reset-backend-table.

Some customers do not allow tools to create tables, object creation must be via existing processes. Therefore we should also provide a --ddl-file option to generate DDL to create the backend table and output it to a file and stop there without copying data. The use of this option will deactivate any -x flag, processing is verification only.

@nj1973 nj1973 added enhancement New feature or request p1 High priority labels Mar 28, 2024
@nj1973 nj1973 self-assigned this Apr 5, 2024
@nj1973 nj1973 added this to the May Release milestone May 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request p1 High priority
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant