Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch user media to s3 + CDN #2899

Closed
pmac opened this issue Jul 26, 2017 · 4 comments
Closed

Switch user media to s3 + CDN #2899

pmac opened this issue Jul 26, 2017 · 4 comments
Assignees

Comments

@pmac
Copy link
Member

pmac commented Jul 26, 2017

Uploaded media needs to go somewhere external to the servers in AWS. S3 is good for this with a CDN (probably CloudFront) in front.

@pmac pmac added this to the Pre AWS Migration milestone Jul 26, 2017
@pmac pmac added this to Backlog (all the things) 🌳 in Kitsune Engineering Jul 26, 2017
@jwhitlock
Copy link
Member

We have a similar requirement on Kuma. I've configured upload to S3 years ago, but we decided to go w/ EFS for the first version (mozmeao/infra#183) for speed of migration.

My dream version is a stand-alone service that takes uploads, performs type detection and security checks, and processes them into display-specific forms (for example shrinking PNG, scaling in-content images, etc.), and uses S3 as an optional backend. The web app interacts with a REST API to request asset state (processing, ready) and get URLs by format.

But, with limited time, we'll probably just get by w/ django-storages.

@glogiotatidis glogiotatidis added this to the Pre AWS Migration milestone Oct 25, 2017
@glogiotatidis glogiotatidis added this to Backlog in SUMO AWS Migration Oct 25, 2017
@bookshelfdave bookshelfdave moved this from Backlog to Queued (Max 6) in SUMO AWS Migration Oct 26, 2017
@bookshelfdave bookshelfdave moved this from Queued (Max 6) to In Progress (Max 6) in SUMO AWS Migration Oct 31, 2017
@bookshelfdave bookshelfdave moved this from In Progress (Max 6) to Review in SUMO AWS Migration Oct 31, 2017
@bookshelfdave bookshelfdave moved this from Review to In Progress (Max 6) in SUMO AWS Migration Oct 31, 2017
@bookshelfdave
Copy link
Contributor

@glogiotatidis @pmac @jgmize
Cloudfront, S3 and Route 53 are setup for the following:

https://dev-cdn.sumo.mozilla.net/
https://stage-cdn.sumo.mozilla.net/
https://prod-cdn.sumo.mozilla.net/

Feel free to remove the index.html page from each dev|stage|prod bucket.

@pmac pmac self-assigned this Nov 7, 2017
pmac added a commit to pmac/kitsune that referenced this issue Nov 8, 2017
Will require changes to server config
@glogiotatidis glogiotatidis moved this from In Progress (Max 6) to Review in SUMO AWS Migration Nov 13, 2017
@glogiotatidis
Copy link
Contributor

glogiotatidis commented Nov 13, 2017

Required Settings:

  • AWS_S3_CUSTOM_DOMAIN
  • AWS_ACCESS_KEY_ID
  • AWS_SECRET_ACCESS_KEY
  • AWS_STORAGE_BUCKET_NAME
  • AWS_S3_HOST
  • MEDIA_URL

pmac added a commit to pmac/kitsune that referenced this issue Nov 29, 2017
Will require changes to server config
pmac added a commit to pmac/kitsune that referenced this issue Nov 29, 2017
Will require changes to server config
glogiotatidis added a commit that referenced this issue Dec 4, 2017
@glogiotatidis
Copy link
Contributor

Wiki documents hold a saved version in Document.html which needs to be updated so media point to the new origins.

@glogiotatidis glogiotatidis moved this from Review to Complete in SUMO AWS Migration Dec 5, 2017
pmac added a commit to pmac/kitsune that referenced this issue Jan 9, 2018
Will require changes to server config
pmac added a commit to pmac/kitsune that referenced this issue Jan 9, 2018
Will require changes to server config
@glogiotatidis glogiotatidis removed this from Backlog (all the things) 🌳 in Kitsune Engineering Jan 16, 2018
@glogiotatidis glogiotatidis moved this from Complete to Icebox in SUMO AWS Migration Jan 17, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

No branches or pull requests

4 participants