Repository navigation
Update On Spot Outage #510
Replies: 5 comments
|
it looks like they lost everything :( even doc pages are down https://spot.rackspace.com/docs what is the service SLA and what are the expected credits that customers are supposed to receive in case everything is down more than 24 h ? 🤔 |
|
i hope RCA will be published as well with measures taken to prevent it to happen in future |
|
@chris-rutherfurd @soanni the team is working as quickly as possible to complete the maintenance activity. We hope to restore full service by end of day today California time. We were earlier aiming for 2pm PST but it looks increasingly unlikely that time will hold. Because of the nature of the incident, we are having to make several intrusive changes to the underlying infrastructure clusters, which is causing this extended outage window. The root cause has been discussed on the subreddit and in emails to customers who reached out: an observability system was breached using a compromised credential. This was obviously a critical error on our part and we are very sorry we let this happen. |
|
ok, thanks. fingers crossed 🤞 |
|
@chris-rutherfurd @soanni we missed our goal to restore service this afternoon. We are expecting to fully restore service by 9am PST 11/21. Please see: |
Uh oh!
There was an error while loading. Please reload this page.
Is there an update on the spot outage or an estimated resolution time. It's been offline for 24 hours already and still no further updates on whats happening?
All reactions