You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Seems like we have either to add a 'simple' fix to remove trailing slash directly to create statement or update path_utils.get_table_prefix_layout function to be smart enough
dlt version
0.4.8
Describe the problem
Athena code to create table_prefix for iceberg table has trailing slash which leads to a path like
s3://*/_dlt_version//metadata
.Here is the query DLT generates to create _dlt_version.
That tiny slash at the end of _dlt_version causes all the problems when DLT tries to write any data to the table
Expected behavior
DLT removes trailing slash for Athena iceberg tables
Steps to reproduce
Just create simple source with resource which writes to Athena
Operating system
Linux
Runtime environment
Airflow
Python version
3.11
dlt data source
No response
dlt destination
AWS Athena / Glue Catalog
Other deployment details
No response
Additional information
No response
The text was updated successfully, but these errors were encountered: