Added chunk_size parameter to LocalFilesystemToGCSOperator #40379
Added chunk_size parameter to LocalFilesystemToGCSOperator #40379potiuk merged 11 commits intoapache:mainfrom
Conversation
|
Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors' Guide (https://github.com/apache/airflow/blob/main/contributing-docs/README.rst)
|
|
Some spell-check issue. |
|
It seems like the spell-check detects 'KiB' as an invalid term, even tough it should be valid. I have removed it. |
|
There is a list of allowed words. KiB is not on it. you can add it there, or you can |
|
I wasn't aware of the list of allowed words. Let me add it to the list. Thanks for letting me know. |
|
Awesome work, congrats on your first merged pull request! You are invited to check our Issue Tracker for additional contributions. |
|
And merged :) |
closes: #38958
related: #38958
This PR added a chunk_size parameter to the LocalFilesystemToGCSOperator. This parameter is already implemented in the GCSHook.upload function. This change ensures that the chunk_size is passed to the upload function.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in newsfragments.