Skip to content

contribution: Jonboulle nell add aws region#1295

Merged
dapollak merged 4 commits into
masterfrom
jonboulle-nell-add-aws-region
Nov 29, 2023
Merged

contribution: Jonboulle nell add aws region#1295
dapollak merged 4 commits into
masterfrom
jonboulle-nell-add-aws-region

Conversation

@dapollak
Copy link
Copy Markdown
Contributor

No description provided.

@github-actions
Copy link
Copy Markdown
Contributor

👋 @dapollak
Thank you for raising your pull request.
Please make sure to add tests and document all user-facing changes.
You can do this by editing the docs files in this pull request.

jonboulle and others added 4 commits November 27, 2023 21:21
When initialising a [Boto3 `Session`](https://boto3.amazonaws.com/v1/documentation/api/latest/guide/session.html#session-configurations) it's useful to be able to specify the AWS Region to which the client should connect.

Add an `--aws-region-name` option to the CLI which gets passed through to the `boto3` client used by the S3 client.

Context:

We're trying to use elementary to write to a Cloudflare R2 bucket, which implements the S3 API. However, the S3 endpoints for these buckets do not encode the region, and hence the `--s3-endpoint-url` flag isn't sufficient to be able to configure elementary to successfully access the buckets.

Without this flag, it means we need write an AWS Profile configuration to disk and pass that in to elementary in order to override the region, which isn't desirable in contexts where we integrate elementary (e.g. invoking it from Airflow).
@dapollak dapollak force-pushed the jonboulle-nell-add-aws-region branch from 83a8099 to 6c387d8 Compare November 29, 2023 12:06
@dapollak dapollak merged commit b3755fd into master Nov 29, 2023
@dapollak dapollak deleted the jonboulle-nell-add-aws-region branch November 29, 2023 12:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants