Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TODO: aws slim down/refactor #9

Open
H-Plus-Time opened this issue Apr 12, 2024 · 1 comment
Open

TODO: aws slim down/refactor #9

H-Plus-Time opened this issue Apr 12, 2024 · 1 comment

Comments

@H-Plus-Time
Copy link
Owner

H-Plus-Time commented Apr 12, 2024 •
edited
Loading

Prior art for this is object_store_s3_wasm for an aws-sdk + siblings based approach.

The original in arrow-rs/object_store is more or less a from-scratch implementation (with the exception of reqwest), and is likely a very bad idea to try to replicate here.
@H-Plus-Time H-Plus-Time changed the title TODO: aws ro support TODO: aws ro support - slim down/refactor Apr 14, 2024
@H-Plus-Time H-Plus-Time changed the title TODO: aws ro support - slim down/refactor TODO: aws slim down/refactor Apr 14, 2024
@H-Plus-Time
Copy link
Owner Author

The version inlined from object_store_s3_wasm includes a number of fairly beefy dependencies (after wasm-opt, the size delta for the aws feature is ~2.5MB on an initial size of 640kB). Hopefully most of those are largely unimportant (that is, we only use one or two structs, that could be inlined).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@H-Plus-Time