Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

❇️ [source-S3] pass in AWS credentials from config when assuming a role #36482

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

imrehg
Copy link
Contributor

@imrehg imrehg commented Mar 26, 2024

With the previous setup, when a role is assumed, credentials are loaded only by boto3's env var loading logic, and not explicitly by the source connector. This meant, that the role assumption didn't work at all, when the credentials (access key ID and secret access key) were provided in the source configuration.

Now explicitly passing the set values, both of these methods should work.

I've tested locally to set up an S3 source correctly with these changes, that previously failed.

With the previous setup, when a role is assumed, credentials are loaded only
by boto3's env var loading logic, and not explicitly by the source connector.
This meant, that the role assumption didn't work at all, when the credentials
(access key ID and secret access key) were provided in the source configuration.

Now explicitly passing the set values, both of these methods should work.
Copy link

vercel bot commented Mar 26, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Mar 26, 2024 0:35am

@marcosmarxm marcosmarxm changed the title Source S3: pass in AWS credentials from config when assuming a role ❇️ [source-S3] pass in AWS credentials from config when assuming a role Mar 26, 2024
@marcosmarxm marcosmarxm added gl team/db-dw-sources Backlog for Database and Data Warehouse Sources team gl-review certified labels Mar 26, 2024
@marcosmarxm
Copy link
Member

Thanks for the contribution @imrehg I added it to the connector backlog as hope they can review in next sprints.
Source S3 is a certified connector and for that reason the review can take some time to finish as the team need to ensure this is the best path to implement the feature or solve the bug.

@evantahler evantahler added team/critical-connectors and removed team/db-dw-sources Backlog for Database and Data Warehouse Sources team labels Mar 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants