Skip to content

Comments

Add note about workaround to potential error with argparse to hdfs#29614

Merged
potiuk merged 1 commit intoapache:mainfrom
potiuk:add-note-about-argparse-to-hdfs-provider
Feb 19, 2023
Merged

Add note about workaround to potential error with argparse to hdfs#29614
potiuk merged 1 commit intoapache:mainfrom
potiuk:add-note-about-argparse-to-hdfs-provider

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Feb 19, 2023

Instead of removing or reimplementing hdfs provider - in the event of a possibility to break argparse, we simply add a note in the provider documentation to remove argprase if such problem happens.

Fixes: #22689


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

Instead of removing or reimplementing hdfs provider - in the event
of a possibility to break argparse, we simply add a note in the
provider documentation to remove argprase if such problem happens.

Fixes: apache#22689
Copy link
Contributor

@Taragolis Taragolis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think also would be nice to detect if it installed and "spam" into the log, e.g. in Hook constructor or in get_conn(). But it can be done by follow-up

@potiuk
Copy link
Member Author

potiuk commented Feb 19, 2023

It's a niche case but yes. We could detect it

@potiuk potiuk merged commit 0a4184e into apache:main Feb 19, 2023
@potiuk potiuk deleted the add-note-about-argparse-to-hdfs-provider branch February 19, 2023 20:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

HDFS provider causes TypeError: __init__() got an unexpected keyword argument 'encoding'

2 participants