Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support to save npz files on s3 #15

Merged
merged 5 commits into from
Jul 25, 2017
Merged

Conversation

kayibal
Copy link

@kayibal kayibal commented Jul 14, 2017

No description provided.

@kayibal kayibal requested a review from Talmaj July 14, 2017 15:25
@codecov
Copy link

codecov bot commented Jul 14, 2017

Codecov Report

Merging #15 into master will increase coverage by 0.42%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #15      +/-   ##
==========================================
+ Coverage   82.31%   82.73%   +0.42%     
==========================================
  Files           6        6              
  Lines         656      672      +16     
==========================================
+ Hits          540      556      +16     
  Misses        116      116
Impacted Files Coverage Δ
sparsity/dask/io.py 79.41% <0%> (+6.33%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1774cc6...f057565. Read the comment docs.

@@ -19,6 +22,27 @@
traildb = False


@contextmanager
def mock_s3_fs(bucket, data=None):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kayibal Could you please add a docstring?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@michcio1234 added :)

Copy link

@Talmaj Talmaj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did you try it out with large files on real S3?

@kayibal
Copy link
Author

kayibal commented Jul 20, 2017

@Talmaj no I didn't but I don't see why this should be different from the tests?

@Talmaj
Copy link

Talmaj commented Jul 21, 2017 via email

@kayibal kayibal force-pushed the enhancement/npz-s3-support branch from ea1595e to f057565 Compare July 25, 2017 13:08
@kayibal kayibal merged commit 5b1d05f into master Jul 25, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants