Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: Support reading from S3 #3504

Merged
3 commits merged into from May 10, 2013

Conversation

@pjob
Copy link

commented May 1, 2013

Tests not written. Will need a way to mock boto.

@ghost

This comment has been minimized.

Copy link

commented May 1, 2013

IMO this doesn't belong in pandas (neither are other API storage services),
users can implement that in their own scripts.

@pjob

This comment has been minimized.

Copy link
Author

commented May 2, 2013

Thanks and I understand your point.

Retrieving files from S3 offers a powerful io experience in pandas given the way people use S3 for logs and other historical record and pandas' handling of compressed files. Perhaps this would be better as its own IO tool similar to the sql wrappers. It would aid the user in retrieving from and setting to S3.

Feel free to close this or move the discussion to a better resource (mailing list, issue tracker).

@ghost

This comment has been minimized.

Copy link

commented May 3, 2013

This has me really stumped for some reason. But I guess I should err on the side of "it's useful",
and we do want to make it as easy to get data into pandas as possible.

Please add a note in RELEASE.rst, and mention boto as an optional dependency in README.md
for this functionality, I'll merge this for 0.11.1.

@nehalecky

This comment has been minimized.

Copy link
Contributor

commented May 3, 2013

That's the spirit all!

@pjob

This comment has been minimized.

Copy link
Author

commented May 6, 2013

@y-p Thank you. Everything should be up to date.

@ghost

This comment has been minimized.

Copy link

commented May 10, 2013

@pjob , can you please add a blurb to io.rst in the docs?

@pjob

This comment has been minimized.

Copy link
Author

commented May 10, 2013

@y-p sure.

ghost pushed a commit that referenced this pull request May 10, 2013
y-p
Merge pull request #3504 from pjob/s3-support
ENH: Support reading from S3

@ghost ghost merged commit 1381c39 into pandas-dev:master May 10, 2013

@ghost

This comment has been minimized.

Copy link

commented May 10, 2013

Thanks.

@cpcloud cpcloud referenced this pull request Jun 15, 2013

This issue was closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.