All systems go!
|Azure Asia East Cluster 1||UP|
|Azure Asia South Cluster 1||UP|
|Azure EU North Cluster 1||UP|
|Azure EU West Cluster 1||UP|
|Azure Japan East Cluster 1||UP|
|Azure Japan West Cluster 1||UP|
|Azure US East Cluster 1||UP|
|Azure US West Cluster 1||UP|
|EC2 EU [Amazon, Heroku] Cluster 1||UP|
|EC2 EU [Amazon, Heroku] Development||UP|
|EC2 US-East [Amazon, Heroku] Cluster 1||UP|
|EC2 US-East [Amazon, Heroku] Cluster 2||UP|
|EC2 US-East [Amazon, Heroku] Cluster 3||UP|
|EC2 US-East [Amazon, Heroku] Cluster 4||UP|
|EC2 US-East [Amazon, Heroku] Cluster 5||UP|
|EC2 US-East [Amazon, Heroku] Development||UP|
|Google US Central [Google, CloudControl] Cluster 1||UP|
|Google US Central [Google, CloudControl] Development||UP|
|Rackspace Dallas Cluster 1||UP|
|New Relic Integration||UP|
|Provisioning of Caches||UP|
Around 6:30am PST this morning (October 3nd), one of the proxy servers was seeing extremely high CPU load and thus very high latency for some incoming requests. We swapped the machine out and connections were back to normal.
This should not have affected connections to any other proxy servers and customers with multiple proxies should have failed over successfully with no incident.
October 3, 2015 13:59 UTC · 3 days ago
From 4:36am until 4:38am US PST the US-East C1 cluster experienced issues accepting new connections across one-third of the machines in the cluster. The cause appears to have been a stampeding herd to one particular backend node, a new node spun up after we detected issues with the machine it was replacing. Currently investigating further and how to prevent such an issue occurring again.
October 1, 2015 12:11 UTC · 5 days ago
Yesterday, from 8:36am until 8:44am US PST, the US-East C1 cluster was unavailable for a large fraction of the users on these machines. While we updated the 'live' status of the cluster at the time, we failed to include a recording of the issue until now. Sorry for that oversight. We are currently preparing a post-mortem to understand and update affected customers.
October 1, 2015 11:53 UTC · 5 days ago
One of the servers on US-East-2 is seeing extremely high latencies. We're routing clients to other proxies, and latencies should stabilize shortly.
September 24, 2015 11:39 UTC · 12 days ago