Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] Add S3Config.from_env functionality #2137

Merged
merged 12 commits into from
Apr 16, 2024
Merged

Conversation

jaychia
Copy link
Contributor

@jaychia jaychia commented Apr 15, 2024

Adds a constructor for S3Config: S3Config.from_env.

This constructor creates an S3Config from the current environment, leveraging our current code for auto-discovering things such as: region, credentials and anonymous mode.

Closes: #2139

@github-actions github-actions bot added the enhancement New feature or request label Apr 15, 2024
Copy link

codecov bot commented Apr 15, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 85.14%. Comparing base (0fe3df7) to head (0c1c9b4).
Report is 3 commits behind head on main.

❗ Current head 0c1c9b4 differs from pull request most recent head 9f1c1ac. Consider uploading reports for the commit 9f1c1ac to get more accurate results

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #2137      +/-   ##
==========================================
- Coverage   85.15%   85.14%   -0.01%     
==========================================
  Files          68       68              
  Lines        7356     7358       +2     
==========================================
+ Hits         6264     6265       +1     
- Misses       1092     1093       +1     

see 1 file with indirect coverage changes

src/daft-io/src/python.rs Outdated Show resolved Hide resolved
@jaychia jaychia changed the title [FEAT] Add IOConfig.from_env functionality [FEAT] Add S3Config.from_env functionality Apr 16, 2024
src/common/io-config/src/python.rs Outdated Show resolved Hide resolved
src/daft-io/src/s3_like.rs Outdated Show resolved Hide resolved
Copy link
Member

@samster25 samster25 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jaychia jaychia enabled auto-merge (squash) April 16, 2024 18:25
@jaychia jaychia merged commit 897b384 into main Apr 16, 2024
29 checks passed
@jaychia jaychia deleted the jay/ioconfig_from_env branch April 16, 2024 18:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Create S3Config from environment
2 participants