Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
MM traffic test: 5% Portland K8s #516
Using the Maintenance Mode plan (issue #409), put SCL3 and AWS production deployments into Maintenance mode, and send 5% or more of MDN traffic to the AWS servers for up to an hour. Monitor with New Relic, Sentry, and manual testing. Record the results and open new issues as needed.
This was successful.
As described in #487 (comment), there are several traffic policies set up. We started in policy v1, with 100% going to SCL3, and spent about 30 minute trying to determine if the DNS change had been applied. We couldn't see it using
We then switched to v2, with 5% of the traffic going to AWS. We could see MDN requests in papertrail and AWS tools. There appeared to be no impact in New Relic or Google Analytics. There were some errors recorded in Sentry for
We switched back to regular mode in production.
For tomorrow's test, we'll try policies that send more traffic to Portland K8s - 5%, then 15%, then 50%, then 100%, as time and resources allow.