Outages Hit Microsoft, Amazon Cloud Datacenters After Lightning Strikes
- By Kurt Mackie
- August 09, 2011
Microsoft and Amazon both suffered brief cloud outages on Sunday when lightning struck cloud datacenters run by both companies in Dublin, Ireland.
Amazon reported through its publicly accessible service health dashboard that a power outage in one of its "availability zones" in Dublin occurred on Sunday, 10:41 a.m. PDT. The lightning caused an explosion and fire that affected backup power systems, as well as hampered Amazon's Elastic Compute Cloud (EC2) service in Europe.
"The transient electric deviation caused by the explosion was large enough that it propagated to a portion of the phase control system that synchronizes the backup generator plant, disabling some of them," the Amazon team wrote at 3:01 p.m. PDT. "Power sources must be phase-synchronized before they can be brought online to load. Bringing these generators online required manual synchronization."
By late in the day on Monday, Amazon had completed copying over data from affected snapshots on its EC2 platform in Dublin, allowing customers to run a recovery tool. The team apparently was still working on "restoring connectivity to affected Single-AZ database instances" for its Amazon Relational Database Service in Ireland, according to the health dashboard.
Meanwhile, Microsoft simply reported via Twitter on Sunday that a "Europe data center power issue affects access to BPOS," referring customers to their private service health dashboards for updates. That this power outage was caused by the same lightning strikes in Dublin that affected Amazon's datacenter was explained in a Data Center Knowledge story. Microsoft referred customers to private dashboards used by Business Productivity Online Service customers for further information. The publicly accessible Microsoft online service notifications page described nothing about the Dublin datacenter problems.
Microsoft apparently restored services somewhat quickly after the lightning strike in Dublin, or within the day on Sunday. The last Twitter post about the Dublin BPOS service outage stated that "BPOS services are back online for EMEA customers."
Microsoft's press release (PDF) on the Dublin facility describes it as "the largest data center outside the United States." It was opened in July of 2009, and uses natural cooling except for "a few days per year." The datacenter uses half the power of comparable facilities, according to the press release.
Kurt Mackie is senior news producer for the 1105 Enterprise Computing Group.