Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

(WIP) fsspec compat #116

Closed
wants to merge 6 commits into from
Closed

(WIP) fsspec compat #116

wants to merge 6 commits into from

Conversation

martindurant
Copy link
Member

Start of compatibility with fsspec.

Note the large amount of removed code.

In [2]: from fsspec.core import open_files
In [3]: open_files('gcs://mdtemp/*.avro', storage_options={'token': 'anon'})
[<OpenFile 'mdtemp/one.avro'>, <OpenFile 'mdtemp/two.avro'>]

@martindurant
Copy link
Member Author

(will fail tests, not updated at all)

@martindurant martindurant changed the title Fsspec compat (WIP) fsspec compat Oct 29, 2018
@martindurant martindurant mentioned this pull request Nov 6, 2018
Open
@martindurant martindurant mentioned this pull request Nov 7, 2018
Open
Martin Durant added 2 commits November 22, 2018 21:01
Merge branch 'master' into fsspec_compat
b5947b2 
Base GCSFile on AbstractBuffered File

Missing: no route to _simple_upload, calls _initiate_upload always
Many tests working [skip ci]
ab50675
@martindurant martindurant mentioned this pull request Nov 26, 2018
Closed
@martindurant martindurant mentioned this pull request Dec 28, 2018
Closed
7 tasks
@martindurant
Copy link
Member Author

Will make new PR with recent changes included to supersede this one.

@martindurant martindurant deleted the fsspec_compat branch June 28, 2019 23:40
@ahmedx2 ahmedx2 mentioned this pull request Aug 27, 2019
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@martindurant