Improve the logs in case native transfers fallbacks to Pandas #1263
Labels
feature
New feature or request
priority/high
High priority
product/python-sdk
Label describing products
Milestone
Please describe the feature you'd like to see
When loading a CSV file from S3 to Snowflake a problem occurs, task fails but the table gets created and the data populated. However logs are not clear enough about it, please see below:
The logs show
0
rows loaded but it's not true.Refer to https://astronomer.slack.com/archives/C02B8SPT93K/p1668615614891269
Describe the solution you'd like
I'd love to see the logs improved to reflect the action properly - meaning mention fallback to Pandas and show how many rows were populated in fact.
The customer came back and said that he used
enable_native_fallback=False
and the data got loaded nevertheless. It's not an expected behaviour, right?He also mentioned that the documentation confuses him, particularly this part (it doesn't mention fallbacking to Python - and by the way, what do you mean by that?):
Additional context
Task that was used:
Acceptance Criteria
enable_native_fallback=False
works as expected.The text was updated successfully, but these errors were encountered: