Configure S3Hook transfer_config_args via service_config#65963
Merged
o-nikolas merged 1 commit intoapache:mainfrom Apr 28, 2026
Merged
Configure S3Hook transfer_config_args via service_config#65963o-nikolas merged 1 commit intoapache:mainfrom
o-nikolas merged 1 commit intoapache:mainfrom
Conversation
c2be3f4 to
ca9d389
Compare
o-nikolas
reviewed
Apr 27, 2026
ca9d389 to
f23a33b
Compare
f23a33b to
249f8ec
Compare
o-nikolas
approved these changes
Apr 28, 2026
79 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Enable configuring the S3 transfer config arguments using the service config
Previously the
transfer_config_argscould only be configured by passing in arguments to theS3Hookobject. This PR makes theS3Hookalso read arguments from the s3service_configin the connection's extras to override this behaviour. e.g.This allows deployment managers to change the transfer config options via configuration, for example in
S3TaskHandler.ioWas generative AI tooling used to co-author this PR?