OVH Strasbourg: Halt and Catch Fire, Data Uploaded to the Cloud

This post is originally published on yoursunny.com blog https://yoursunny.com/t/2021/OVH-halt-and-catch-fire/

2021-03-10, an OVH Cloud data center in Strasbourg, France caught on fire.
Thousands of servers have been destroyed by fire.
Thousands more are currently unavailable due to power cut, and will remain offline for several more days.

Data stored in those servers have been uploaded to the cloud via black smoke.

According to Hacker News, a Dev mistakenly invoked the Halt and Catch Fire instruction on an Uninterrupted Power Supply unit, causing this incident.

Chairman of OVH cloud advised clients to activate their disaster recovery plans, such as restoring off-site backups to a new cloud server.
Some clients are crying because they did not have backups, or they stored their backups on another machine in the same data center.
Other clients experienced no downtime because they designed their systems for datacenter scale redundancy.