Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store photos in another cloud storage to reduce operating cost #791

Closed
1 of 4 tasks
vnugent opened this issue Apr 22, 2023 · 0 comments
Closed
1 of 4 tasks

Store photos in another cloud storage to reduce operating cost #791

vnugent opened this issue Apr 22, 2023 · 0 comments
Assignees
Labels
Milestone

Comments

@vnugent
Copy link
Contributor

vnugent commented Apr 22, 2023

What would you like to be able to do? Please describe.

I picked Sirv.com as the media management provider for rapid development of photo uploading feature. We're currently using the paid tier with 2 accounts (prod + staging/dev) and with extra bandwidth monthly costs have recently gone up to 49EUR/month (39 + 10 for the recent extra bandwidth).

Sirv.com

Pros:

  • on-the-fly photo resizing

Cons:

  • cost
  • API features are limited

Amazon or Google Cloud storage

Pros:

  • way less expensive
  • more powerful APIs

Cons:

  • Only serve original image. Need to roll our own resizer.

I think a cloud storage from GCloud or AWS would be a lot and allow us to scale. Several things we will have to do:

  • Migrate photos to the new storage
  • Change Sirv upload/searchAPI -> S3 API
  • Create an on-the-fly image resizer (a serverless function)
  • When we create a new tag, we will need to store image metadata in our backend. This will significantly simplify a lot of the current frontend logic where tag data and media metadata are in 2 different places.

How important is this to you (Please pick one)

  • Important

I underestimated the amount of bandwidth incurred. We exceeded the 20GB/month transfer in Feb/March. We can't afford 50EUR/month.

@vnugent vnugent added the help wanted Extra attention is needed label Apr 22, 2023
@vnugent vnugent added this to the v0.9 milestone Apr 22, 2023
@vnugent vnugent changed the title Store photos in S3-compatible storage Store photos in S3-compatible storage to reduce operating cost Apr 22, 2023
@vnugent vnugent self-assigned this Apr 24, 2023
@vnugent vnugent added chore and removed help wanted Extra attention is needed labels Apr 25, 2023
@vnugent vnugent changed the title Store photos in S3-compatible storage to reduce operating cost Store photos in another cloud storage to reduce operating cost Apr 26, 2023
@vnugent vnugent closed this as completed May 10, 2023
@vnugent vnugent mentioned this issue Jun 29, 2023
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant