Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Google Cloud Storage Support (Storage backends) #685

Closed
mattes opened this issue Apr 9, 2014 · 8 comments · Fixed by #2923 or #3608
Closed

Google Cloud Storage Support (Storage backends) #685

mattes opened this issue Apr 9, 2014 · 8 comments · Fixed by #2923 or #3608

Comments

@mattes
Copy link

mattes commented Apr 9, 2014

Does it make sense to support Google Cloud Storage as storage backend? Boto already supports Cloud storage: http://boto.readthedocs.org/en/latest/ref/gs.html

@nramirezuy
Copy link
Contributor

It would be nice to have, can you implement it?

@nyov
Copy link
Contributor

nyov commented Apr 13, 2014

boto is ok for aw services, but for more generic cloud (storage) interaction, I'd look into pyrax to build on, a python-cloudfiles replacement.

@dangra
Copy link
Member

dangra commented Apr 24, 2014

boto is an optional dependency, it is fine to add backends based on other optional libraries.

does pyrax support Google Cloud Storage? it looks like a openstack only thing.

@nyov
Copy link
Contributor

nyov commented Apr 26, 2014

I haven't tried, since I'm not using google's stuff, but I thought it should - it's s3-compat from what I can see, though I understand there are small differences between s3 and swift api implementations.

I was seeing pyrax as the most generic solution here since openstack's becoming the baseline tools api, but if I'm wrong, libcloud looks good as well and seems to support google c.s.

That way it wouldn't be a google-only backend here, but hopefully useable with many object storage providers, like rackspace cloud, ovh hubic (cloudfiles-version), and of course all openstack swift users, maybe riak and more.

@aidiss
Copy link

aidiss commented Apr 8, 2017

I would like to try to implement it but I don't think I have the skills to do that on my own.

@rhoboro
Copy link
Contributor

rhoboro commented Sep 13, 2017

I implemented this feature. Please check my PR 🙏

dangra added a commit that referenced this issue Oct 2, 2017
[MRG+2] Fixes #685 FilesPipeline support for Google Cloud Storage.
@victor-torres
Copy link
Contributor

I think we could reopen this issue. The GCS support was added only as a File Store and not as a Feed Storage.

@dangra dangra reopened this Jan 16, 2019
@ejulio
Copy link
Contributor

ejulio commented Feb 1, 2019

I implemented the GCS feed export in this PR.
Can someone check it?

Please note, it is a work in progress at this moment.

kmike added a commit that referenced this issue Jul 16, 2020
[MRG+1] Fix for #685 Add Google Cloud Storage Feed Export
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
9 participants