Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: add support for interacting with s3 #5319

Closed
starpit opened this issue Aug 8, 2020 · 0 comments · Fixed by #5320
Closed

feature: add support for interacting with s3 #5319

starpit opened this issue Aug 8, 2020 · 0 comments · Fixed by #5320

Comments

@starpit
Copy link
Contributor

starpit commented Aug 8, 2020 •
edited

Proposal

Introduce a thin VFS that allows us to build out (over time) support for interacting with s3 storage via standard filesystem commands. The minio client does something similar, maybe we can leverage it, if it helps.

Examples

  1. ls /s3 should produce the same output as a filesystem list, but listing my buckets
  2. ls /s3/bucket1 ibid, but listing the objects in that bucket
  3. cp ./local/file /s3/bucket1 sugar for putObject
  4. rm /s3/bucket1/file sugar for removeObject
  5. rm -r /s3/bucket1 sugar for listObjects.map(removeObject), followed by removeBucket
  6. mkdir /s3/bucket2 sugar for createBucket
  7. rmdir /s3/bucket2 sugar for removeBucket

and so on
starpit added a commit to starpit/kui that referenced this issue Aug 8, 2020
@starpit
feat: s3 plugin, and vfs
4a6e612 
This covers most of the examples in the issue. It doesn't cover every possible use case, yet.

Fixes kubernetes-sigs#5319
starpit added a commit to starpit/kui that referenced this issue Aug 8, 2020
@starpit
feat: s3 plugin, and vfs
c2e6946 
This covers most of the examples in the issue. It doesn't cover every possible use case, yet.

Providers supported:
1) local minio
2) ibm cloud object storage

TODO: AWS and Azure storage?
TODO: other use cases, e.g. cat file > /s3/bucket1/foo

Fixes kubernetes-sigs#5319
@starpit starpit mentioned this issue Aug 8, 2020
Merged
7 tasks
starpit added a commit to starpit/kui that referenced this issue Aug 9, 2020
@starpit
feat: s3 plugin, and vfs
e668848 
This covers most of the examples in the issue. It doesn't cover every possible use case, yet.

Providers supported:
1) local minio
2) ibm cloud object storage

TODO: AWS and Azure storage?
TODO: other use cases, e.g. cat file > /s3/bucket1/foo

Fixes kubernetes-sigs#5319
starpit added a commit to starpit/kui that referenced this issue Aug 9, 2020
@starpit
feat: s3 plugin, and vfs
97fea04 
This covers most of the examples in the issue. It doesn't cover every possible use case, yet.

Providers supported:
1) local minio
2) ibm cloud object storage

TODO: AWS and Azure storage?
TODO: other use cases, e.g. cat file > /s3/bucket1/foo

Fixes kubernetes-sigs#5319
starpit added a commit that referenced this issue Aug 9, 2020
@starpit
feat: s3 plugin, and vfs
970ba6e 
This covers most of the examples in the issue. It doesn't cover every possible use case, yet.

Providers supported:
1) local minio
2) ibm cloud object storage

TODO: AWS and Azure storage?
TODO: other use cases, e.g. cat file > /s3/bucket1/foo

Fixes #5319
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: s3 plugin, and vfs starpit/kui
1 participant
@starpit