Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Research: Cloud Object Storage #63

Open
nelsonic opened this issue Oct 3, 2018 · 9 comments
Open

Research: Cloud Object Storage #63

nelsonic opened this issue Oct 3, 2018 · 9 comments
Labels
chore a tedious but necessary task often paying technical debt discuss Share your constructive thoughts on how to make progress with this issue enhancement New feature or enhancement of existing functionality help wanted If you can help make progress with this issue, please comment! priority-2 Second highest priority, should be worked on as soon as the Priority-1 issues are finished research Research required; be specific tech-debt A feature/requirement implemented in a sub-optimal way & must be re-written technical A technical issue that requires understanding of the code, infrastructure or dependencies

Comments

@nelsonic
Copy link
Member

nelsonic commented Oct 3, 2018

We need to decide where to place our "bet" for cloud storage.
AWS S3 is one of the most expensive Object Storage Options.
BackBlaze is by far the cheapest:
https://www.backblaze.com/b2/cloud-storage-pricing.html
image
According to this post on Reddit:
https://www.reddit.com/r/DataHoarder/comments/877z0s/options_for_uk_or_eu_based_cloud_storage_similar
BackBlaze are planning to open a Data Centre in Europe in Q3 of 2018 ...
If that happens we can use "B2" for all our backups and save 75% of the cost over s3! 😮
@nelsonic nelsonic added discuss Share your constructive thoughts on how to make progress with this issue chore a tedious but necessary task often paying technical debt technical A technical issue that requires understanding of the code, infrastructure or dependencies labels Oct 3, 2018
@matrixik
Copy link

matrixik commented Oct 3, 2018

http://gaul.org/object-store-comparison/

@nelsonic
Copy link
Member Author

nelsonic commented Oct 3, 2018 •
edited

@matrixik fantastic thanks! 🥇
looks like https://www.online.net/en/c14#pricing is worth considering.

@matrixik
Copy link

matrixik commented Oct 3, 2018

You need to take into account that some of this services have some catches that are not described on this page (like Wasabi want you to pay up front for 90 days of storage for every file if I remember correctly).

@nelsonic
Copy link
Member Author

nelsonic commented Oct 3, 2018

@matrixik yeah, Wasabi are catering to people who can plan/forecast their usage requirements.
To be fair, if people don't have at least some forecast-ability, they don't really "understand" their App.

https://www.scaleway.com are not yet in the comparison table , because they haven't released their Object Store, but I suspect that their prices are going to be pretty competitive once they release!
Considering the price of their SSD-based Virtual Private servers and even "Bare Metal":
image
https://www.scaleway.com/baremetal-cloud-servers/
image

I'm thinking of using https://www.scaleway.com for my "pet project"
(which has no revenue so costs need to be kept as low as possible...)

@matrixik
Copy link

matrixik commented Oct 9, 2018

https://blog.online.net/2018/10/04/scaleway-object-storage-beta/

@nelsonic
Copy link
Member Author

nelsonic commented Oct 9, 2018

@matrixik Thanks for sharing! 🥇
Looks like the bandwidth is where they will be making up for their "cheap" storage price:
scaleway-object-storage-bandwidth-cost

We may need to do some "arbitrage" when it comes to our object storage costs ... 🤔
but for now, I think Scaleway looks to be the best option for storing large volumes of arbitrary data. 👍
Thanks again! ✨

@matrixik
Copy link

matrixik commented Oct 9, 2018

BackBlaze and C14 still looks cheaper.

@nelsonic
Copy link
Member Author

nelsonic commented Oct 9, 2018

@matrixik yeah, our only issue with BackBlaze is location ... 🌎
If they open their EU-based data centre we can comply with EU-only storage laws ⚖️
for some of our more "demanding" clients which have forced us to use AWS S3 until now. 💸

@nelsonic nelsonic mentioned this issue Oct 22, 2018
Closed
@nelsonic nelsonic changed the title Cloud Object Storage Research: Cloud Object Storage Aug 17, 2022
@nelsonic nelsonic added enhancement New feature or enhancement of existing functionality help wanted If you can help make progress with this issue, please comment! priority-2 Second highest priority, should be worked on as soon as the Priority-1 issues are finished research Research required; be specific tech-debt A feature/requirement implemented in a sub-optimal way & must be re-written labels Jul 6, 2023
@nelsonic nelsonic mentioned this issue Jul 7, 2023
Open
@nelsonic
Copy link
Member Author

Meanwhile ... since the last comment in this thread, BackBlaze has a datacenter in Amsterdam:
https://help.backblaze.com/hc/en-us/articles/360034360834-EU-Region-FAQ 🇳🇱
This is perfect for us to stay EU GDPR compliant. 👌

@nelsonic nelsonic mentioned this issue Jul 17, 2023
Open
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
chore a tedious but necessary task often paying technical debt discuss Share your constructive thoughts on how to make progress with this issue enhancement New feature or enhancement of existing functionality help wanted If you can help make progress with this issue, please comment! priority-2 Second highest priority, should be worked on as soon as the Priority-1 issues are finished research Research required; be specific tech-debt A feature/requirement implemented in a sub-optimal way & must be re-written technical A technical issue that requires understanding of the code, infrastructure or dependencies
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@nelsonic @matrixik